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The  major  goal  of  the  research  presented  in  this  dissertation  is  to  develop  an  effi- 
cient framework  composed  of  a digital  signal  processing  (DSP)  and  analog  CMOS-VLSI 
implementation  platforms  to  design,  simulate  and  study  Freeman’s  model  of  the  olfactory 
cortex.  Conceptually,  this  biologically  plausible  model  is  a coupled  lattice  with  local  sta- 
ble dynamics  but  with  global  nonconvergent  behavior.  The  methodology  followed  in  this 
research  shows  that  Freeman’s  model  can  be  efficiently  discretized  using  DSP  techniques, 
providing  an  alternative  to  more  traditional  Runge-Kutta  integration  methods.  An  obvious 
outcome  of  the  system’s  discretization  is  that  a network  of  dynamic  components  can 
implement  the  resulting  discrete  time  model,  which  enhances  analysis  and  optimization  of 
Freeman’s  model  for  information  processing. 

For  optimization  purposes,  the  digital  computer  is  more  flexible,  and  allows  for 
immediate  parameter  setting  and  topology  manipulation.  However  it  is  not  the  most  effi- 
cient in  computational  terms.  Analog  implementations  are  preferred  in  terms  of  round-off 

viii 


noise,  power  and  speed,  but  bring  the  problem  of  determining  appropriate  parameters. 
This  work  proposes  a mixed  signal  (analog  amplitude  discrete-time)  CMOS-VLSI  imple- 
mentation of  Freeman’s  model  that  is  unified  functionally  with  the  DSP  simulation. 
Hence,  the  DSP  machine  can  be  efficiently  used  to  find  parameter  sets  that  give  equivalent 
responses  to  the  analog  system.  The  fine  tuning  should  be  operated  on  the  DSP  model  and 
computed  at  the  analog  implementation  level. 

In  this  dissertation,  we  propose,  fabricate,  and  test  the  required  building  blocks  of 
Freeman’s  model.  The  dynamical  part  of  Freeman’s  model  is  the  hardest  to  implement. 
Due  to  the  slow  dynamics,  it  is  really  a challenge  to  implement  such  a system  in  a small 
area  and  be  power  efficient.  A local  offset  cancellation  method  is  proposed  for  the  gamma 
kernel,  with  low  sensitivity  to  the  feedback  parameter  and  implemented  with  switch-cur- 
rent  (SI)  techniques.  A novel  class  of  discrete  state  filters  is  developed,  called  filter  and 
hold  (F&H  patent  pending).  The  F&H  techniques  are  step  invariant  and  allow  the  integra- 
tion of  long  time  constants  with  reasonably  small  area.  Finally,  a multiplexing  method  is 
proposed  and  tested  that  take  full  advantage  of  the  F&H  innovation,  efficiently  allocates 
fewer  resources  among  all  channels,  and  is  transparent  to  the  computation  being  imple- 
mented. Several  chips  were  fabricated  and  measured  to  prove  the  operationality  of  each 
proposed  block,  and  to  demonstrate  that  both  the  DSP  and  analog  chips  behave  as  pre- 
dicted. 


IX 


CHAPTER  1 
INTRODUCTION 

1.1  Introduction 

This  dissertation  develops  an  efficient  framework,  as  well  as  analog  and  digital 
implementation  platforms,  to  facilitate  the  study  and  design  of  Freeman’s  model  of  the 
olfactory  cortex.  Conceptually,  this  biologically  plausible  model  is  a coupled  lattice  with 
local  stable  dynamics  but  with  global  nonconvergent  behavior.  Instead  of  modeling  the 
olfactory  cortex  at  the  neuron  level,  Freeman  [1-3]  has  proposed  an  hierarchical  dynami- 
cal model  that  bases  its  formal  representation  on  the  response  of  thousands  of  cells  called 
the  neural  cell  assembly.  Each  cell  assembly  is  described  by  a second  order  dynamical 
equation.  This  level  of  description  has  been  called  mesoscopic  to  mean  an  intermediate 
level  between  global  states  that  lead  to  behavior  and  single  neurons.  The  functional  and 
anatomical  connections  between  cell  assemblies  are  also  modeled,  and  the  result  is  a com- 
plex dynamical  system  built  from  basic  second  order  nonlinear  elements  in  a hierarchy  of 
levels  called  Katchalsky  [1]  and  designated  by  KO,  KI,  KII  and  Kill.  At  a first  glance. 
Freeman  s model  of  the  olfactory  system  may  look  similar  to  artificial  neural  networks 
(ANN)  found  in  engineering,  which  are  also  arrangements  of  static  or  dynamic  PEs  (pro- 
cessing elements)  [4-7],  However,  unlike  ANN  topologies,  in  the  olfactory  cortex  there  is 
a very  tight  relation  between  topological  arrangement  of  neurons  and  function,  that  is  pre- 
served in  the  Katchalsky  set.  Furthermore,  Freeman  reports  that  the  computational  para- 
digm is  based  on  nonconvergent  dynamics  [3]  (i.e.,  dynamical  systems  that  have 
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singularities  higher  than  second  order— chaotic  attractors  [8-11]) . This  marginally  stable 
system  may  be  able  to  respond  rapidly  with  high  sensitivity  and  specificity  to  minute 
changes  in  the  input,  and  recover  effortlessly  while  waiting  for  the  next  input.  Conversely, 
a system  exhibiting  point  attractor  dynamics  (such  as  the  Hopfield  nets  [12,13]),  needs 
large  input  energy  to  begin  a new  search.  Thus,  it  seems  that  dynamical  systems  with 
higher  order  singularities,  namely  the  ones  that  exhibit  nonconvergent  dynamics,  comply 
with  rapid  response  to  input  changes  due  to  the  sensitivity  to  initial  conditions,  allowing 
quick  trajectory  divergence  from  small  input  energy  differences.  This  is  very  different 
from  what  has  been  done  in  neural  networks  and  machine  learning.  Freeman’s  model 
breaks  with  the  logic  of  fixed-point  terminal  dynamics,  advancing  a new  computational 
paradigm  for  information  processing.  But  it  also  raises  many  difficult  questions  such  as, 
how  is  information  represented  in  these  nonconvergent  systems,  what  is  the  importance  of 
nonconvergent  dynamics  in  information  processing,  and  how  can  we  retrieve  information 
from  the  resulting  complex  time  series?  The  answer  to  these  questions  will  bring  an  all 
new  perspective  on  information  and  signal  processing.  However,  to  answer  these  ques- 
tions, more  flexible  and  efficient  computational  platforms  are  needed,  and  this  is  the  moti- 
vation behind  this  dissertation. 


1.2  Olfactory  Cortex  Model 

1.2,1  Population  Models 

Neurons  are  the  discrete  components  that  form  a neural  network  [14],  They  are 
interconnected  in  a structure  to  perform  some  higher  level  operation.  A neuron  can  accept 
inputs  from  thousands  of  other  neurons  and  conversely  drive  as  many  others.  However, 


3 


Freeman  has  stated  that  information  processing  transcends  the  neuron  level.  Information 
processing  instead  is  a group  property  because,  in  sensory  cortices  neurons  are  for  the 
most  seen  as  having  random  firing  patterns  [15,16],  Thus,  the  appropriate  scale  to  model 
information  processing  in  the  brain,  is  the  mesoscopic  level.  Instead  of  single  neurons, 
Freeman’s  model  classifies  populations  of  neurons  as  continuous  functions  representing 
the  main  connections  in  the  population  called  a neural  set.  Furthermore,  it  is  also  possible 
to  classify  the  principal  connections  between  the  sets.  The  neural  network  then  takes  the 
form  of  a network  of  sets. 

Neural  and  network  sets  are  functional  structural  level  representations  of  physical 
networks.  The  descriptive  approach  of  neurons  and  networks  as  functional  structures 
imply  the  introduction  of  functional  connections.  These  are  functions  that  describe  rela- 
tions between  neural  sets.  In  this  perspective  we  have  to  interpret  them  as  mesoscopic 
models  when  compared  to  the  microscopic  individual  neurons.  The  same  applies  to  the 
states  referred  to  as  mesoscopic-states  representing  the  state  of  a neuron  population.  These 
functions  represent  the  relations  between  the  set  states  (mesoscopic-states). 

Although  individual  neurons  have  outputs  represented  by  discrete  spikes,  the  den- 
sity of  spikes  measured  in  a population  of  neighborhood  neurons  can  be  modeled  as  a con- 
tinuous variable  [1,2].  A mesoscopic  state  emerges  in  neural  sets  as  continuous  activity 
density  functions,  varying  both  in  space  (depends  on  the  neuron’s  relative  position  on  a 
neural  mass),  and  in  time  (integration  performed  at  the  neuron’s  membranes).  This  is  true 
under  the  assumption  that  for  vanishingly  small  regions,  the  neighborhood  neurons  in  that 
region  share  similar  inputs  and  so  have  similar  states.  The  activity  density  functions  are 
derived  from  neuron  models  and  measurements  made  in  living,  but  anesthetized  animal 
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brains  [1].  These  models  are  better  described  in  terms  of  dynamics  and  are  expressed  in 
two  modes:  a wave  mode,  representing  the  pulse  to  wave  transformation  in  the  set;  and  a 
pulse  mode,  representing  the  output  activity  of  the  set. 

Depending  on  the  main  type  of  functional  interconnections  between  neurons  in  a set, 
a topological  hierarchy  of  sets  can  be  built.  Because  sets  are  represented  by  dynamical 
models,  the  network  of  sets  can  become  extremely  complex  and  intractable  when 
described  as  a whole.  To  make  the  model  more  amenable,  the  complexity  is  wrapped  in  a 
hierarchy  embedding  simpler  structures  that  are  repeated  as  the  network  grows  into  more 
complex  topologies.  The  hierarchy  levels  in  increasing  order  of  complexity  are  designated 
by  KO,  KI,  KII,  Kill  (K  stands  for  Katchalsky  due  to  his  pioneer  work  [1])  and  will  be 
described  below.  From  an  engineering  perspective  the  hierarchical  model  is  also  very 
appealing  because  it  allows  the  same  basic  building  blocks  to  be  used  and  reused. 


KO  set.  The  neural  population  in  a KO  neural  set,  shares  common  inputs  and  a common 
sign  for  the  output:  either  positive  for  excitatory  neurons,  or  negative  for  inhibitory  neu- 
rons, and  is  the  basic  building  block  of  all  networks.  The  model  can  accept  several  spatial 


1.2.2  The  KO  model 


The  simpler  structure  in  the  hierarchy  of  sets  is  shown  in  Figure  1-1  and  is  called  the 


inputs  that  are  weighted  and  summed.  This  input  is  then  processed  by  a 2nd  order  linear 


time  invariant  system,  defined  by  Eq.  (1-1). 


(t)  + (a  + b)^-x(t)  + a ■ bx(t)  = f(t) 


dt  ) 


(1-1) 
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Output 


Summing  node  2nd  order  dynamics  Static  asymmetric  non-linear  function 

Figure  1-1.  The  KO  model 


Equation  (1-1)  together  with  the  weighted  sum  of  the  input,  forms  the  pulse-to-wave 
density  activity  function  where  the  integration  is  performed.  This  function  is  empirically 
obtained  from  averaged  measurements  done  in  a specific  brain  region  of  an  anesthetized 
animal  [17].  Measurements  are  taken  from  multiple  trials  as  an  average  of  the  extracellular 
neural  potential.  It  reflects  the  many  dendritic  currents  taken  as  an  average  from  many 
neurons  in  the  region  [2].  The  filtered  wave  signal  is  then  reconverted  into  a pulse-wave 
signal.  The  conversion  is  nonlinear  and  is  defined  in  the  olfactory  model  by  Eq.  (1-2).  The 
KO  symbol  is  shown  in  Figure  1-2  and  Figure  1-3  shows  an  example  of  a KO  network  set. 
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Figure  1-2.  The  KO  symbol 
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Figure  1-3.  KO  network  set 


1.2.3  The  KI  Model 

The  KI  set  is  the  second  model  in  the  hierarchy.  It  can  be  built  from  KO  cells  that 
interact  through  lateral  feedback  (auto-feedback  is  not  allowed)  of  common  sign:  positive 
for  excitatory  KI  sets  or  negative  for  inhibitory  KI  set  (Figure  1-4). 

A KI  network  set  is  made  of  fully  interconnected  KI  cells  shown  in  Figure  1-5.  The 
interconnecting  weights  vary  both  in  space  and  time.  Nevertheless,  it  is  sufficient  to  define 
the  lumped  circuit  model  where  the  feedback  weights  are  fixed  (i.e.,  it  means  that  the  sub- 
ject is  in  a given  physiological  stage,  e.g.,  awake  or  asleep).  The  interconnectivity  is 
defined  by  Eq.  (1-3)  where /)•(?)  represent  the  forcing  input  in  Eq.  (1-1)  (I  is  an  input  vector 
and  the  indexes  stand  for  cell  position  in  the  network). 
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Figure  1-4.  Excitatory  KI  set  model 


+ 


1,2.4  The  KII  Model 

The  third  level  of  the  Katchalsky  hierarchy  is  the  KII  model.  This  is  the  most  impor- 
tant building  block  of  the  overall  olfactory  system.  The  KII  set  can  be  built  from  two  KI 
sets,  interacting  through  both  excitatory  and  inhibitory  connections.  Figure  1-6  is  a topo- 
logical representation  of  a KII  set  that  is  used  to  model  the  olfactory  bulb  (Section  1.2.5). 
The  KII  set  is  defined  by  Eq.  (1-4)  (Figure  1-6  for  indexes). 
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Figure  1-6.  The  KII  set  model 


The  KH  set  has  a peculiar  behavior.  The  response  to  an  impulse  is  a damped  oscilla- 
tion. However,  with  a sustained  input  it  evolves  into  an  undamped  oscillation  which  van- 
ishes only  after  the  input  returns  to  zero.  Therefore,  the  KII  set  is  an  oscillator  controlled 
by  the  input. 

Figure  1-7  shows  a representation  of  a KII  network  set.  Considering  functionality, 
the  KII  network  is  an  arrangement  of  mutually  coupled  oscillators.  With  a more  careful 
look  into  Figure  1-7,  two  main  types  of  interconnections  can  be  discerned:  excitatory 
through  the  top  KO  cells  and  inhibitory  through  the  bottom  KO  cells.  The  inhibitory  con- 
nections are  fixed  while  the  excitatory  ones  are  trainable.  By  strengthening  excitatory  con- 
nections the  coupling  increases.  With  the  input  presence,  stronger  coupled  sets  will  build 
more  energy  oscillation  than  the  others.  At  the  same  time,  they  will  inhibit  even  more  the 
other  sets  from  building  energy  through  the  inhibitory  connections.  Thus,  the  excitatory 
connections  are  responsible  for  cooperative  behavior  while  inhibitory  connections  intro- 
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the  channels  [17]  (a  channel  is  an  input  or  output  taken  from  a single  set).  In  this  perspec- 
tive the  KII  network  is  an  associative  memory  that  associates  an  input  pattern  with  the 
spatial  distributed  coupling  that  is  stored  in  the  interconnections  [17,18]. 


Figure  1-7.  The  KII  network  set 


For  “on-off”  type  of  input  patterns,  the  learning  can  be  accomplished  with  a modi- 
fied Hebbian  rule  as  follow  [17].  If  between  any  two  input  channels  the  product  Ij  ■ 7(  (i,  j 
are  channel  indexes)  is  equal  to  “on”  (both  “on”),  then  the  connections  between  the  corre- 
sponding channels  are  increased  to  a high  value,  otherwise  the  value  is  kept  unchanged.  At 
the  beginning  with  no  learned  patterns,  all  these  connections  are  set  at  a low  value.  This 
method  effectively  unbalances  the  in-between  channels  coupling  to  accomplish  the  pattern 
representation. 

1.2.5  The  Kill  Model — The  Olfactory  System 

The  final  Katchalsky  level  is  the  Kill  network  and  represents  the  olfactory  model. 
The  Kill  model  is  a variant  of  the  KII  network  with  several  layers  of  these  elements  con- 
nected through  linear  delay  functions. 
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The  full  model  is  depicted  in  Figure  1-8  and  the  names  for  the  different  layers  and 
K0  cells,  represent  real  cortical  regions  and  cells,  of  a mammalian  brain.  The  inputs  are 
collected  at  the  receptors  in  the  nose  and  are  represented  in  the  model  by  a set  of  inputs. 
These  inputs  are  then  fed  into  the  periglomerular  layer  (PG)  made  up  of  periglomerular 
(P)  cells  and  into  the  mitral  cells  (M)  at  the  olfactory  bulb  (OB).  Mitral  cells  are  the  origin 
of  all  the  signals  for  the  rest  of  the  olfactory  system  and  they  interact  with  granular  cells 
(G)  to  form  the  KII  oscillators. 


Figure  1-8.  The  Kill  network  set — the  olfactory  system 


The  output  collected  from  mitral  cells  excite  the  anterior  olfactory  nucleus  (AON) 
and  the  prepyriform  cortex  (PC).  The  PC  output  goes  into  the  external  capsule  (EC)  by 
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deep  pyramidal  cells  (C)  and  also  disperses  into  the  AON  and  OB.  AON  by  its  turn  does 
the  same  into  the  granule  cells  in  the  OB  and  into  the  PG  layer. 

The  axons  that  interconnect  different  regions  of  the  brain,  have  different  thicknesses 
and  lengths,  differentiating  their  electric  properties.  Consequently,  the  action  potentials 
arrive  at  the  target  with  different  delays.  The  effect  is  a low-pass  filtering  operation  of  the 
axon  density  pulses  [3]  and  are  modeled  by  the  dispersive  delay  functions  shown  in 
Figure  1-8. 

The  Kill  network  is  functionally  similar  to  the  KII  network.  However,  the  natural 
frequencies  of  the  KII  cells  in  the  OB  layer  and  the  other  layers,  are  incommensurable. 
This  together  with  the  different  interlayer  dispersive  delays  interaction,  the  natural  ten- 
dency for  the  oscillators  to  lock  to  a single  frequency  is  prevented  and  nonconvergent, 
chaotic  behavior  arises  [16].  From  the  point  of  view  of  information  processing,  the  Kill  is 
a highly  unstable  associative  memory.  When  there  is  no  input  excitation,  the  system  state 
exists  in  a high  dimensional  attractor  (the  basal  attractor).  This  high  dynamical  dimension- 
ality means  that  the  system  can  quickly  reach  any  point  in  its  state  space,  and  quickly  react 
to  any  input.  Once  the  input  is  applied  the  system  dimensionality  is  reduced  to  a lower 
chaotic  attractor  where  recognition  takes  place.  Once  the  input  disappears,  the  Kill  goes 
back  to  the  basal  state. 

1.3  Motivation  for  the  Dissertation 

Freeman’s  model  discussed  above  is  biologically  realistic,  but  extremely  difficult  to 
understand  from  the  point  of  view  of  information  processing.  Engineering  systems  are 
designed  to  be  stable,  and  therefore  avoid  nonconvergent  regimes.  Understanding  Free- 
man’s model  is  therefore  crucial  to  further  our  knowledge  about  brain  dynamics,  and 
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devise  man-made  systems  with  similar  properties.  Freeman’s  model  is  normally  simulated 
using  high-level  numerical  integration  methods,  that  are  time  consuming  and  not  amena- 
ble to  simple  modifications.  In  this  dissertation  we  propose  an  equivalent  digital  model 
using  DSP  (digital  signal  processing)  techniques.  The  result  is  a system  made  of  compo- 
nents that  can  easily  be  subject  to  alterations.  It  also  brings  easier  probing,  it  is  computa- 
tionally more  efficient  and  it  is  better  fitted  for  real-time  simulations  because  the  system  is 
updated  on  a sample-by-sample  basis. 

The  flexibility,  immunity  to  noise  and  modularity  of  the  DSP  implementation  is 
unsurpassed  when  compared  to  analog  VLSI  implementations.  However,  there  are  advan- 
tages in  analog  VLSI  that  cannot  be  overlooked  such  as:  speed  (only  limited  by  the  delay 
on  each  component),  intrinsic  parallel  computation,  effective  infinite  magnitude  resolution 
(free  of  round-off  problems),  and  power  efficiency.  These  benefits  motivate  the  develop- 
ment of  an  analog  VLSI  implementation  preserving  as  much  as  possible  the  functional 
correspondence  to  the  digital  design.  The  DSP  simulator  may  then  be  used  to  find  the  right 
analog  VLSI  circuit  parameters  avoiding  the  burdensome  task  of  finding  the  appropriate 
parameters  with  analog  circuit  simulators.  Our  analog  design  approach  is  centered  on  con- 
tinuous magnitude  and  discrete-time  implementation  for  the  following  reasons: 

• Continuous  magnitude  response  avoids  round-off  errors  that  has  been  reported  to 
have  a negative  effect  on  the  simulation  of  chaotic  dynamical  systems  [19-22]. 

• The  full  olfactory  cortex  model  is  made  of  many  repeated  cells  fully  intercon- 
nected. If  a full  analog  (continuous-time)  implementation  is  followed,  the  number 
of  resources  and  area  required  for  the  interconnect  would  be  prohibitive.  With  a 
discrete-time  implementation  control  over  the  timing  of  events  is  gained.  The  syn- 
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chronous  update  at  discrete  times  provide  free  time  slots  for  transparent  multiplex- 
ing with  consequent  optimal  resource  management. 

• It  allows  for  DSP  formal  correspondence  which  is  important  for  parameter  search. 

• Unexpectedly,  time  discretization  also  lead  to  a very  efficient  implementation  of 
the  slow  dynamics  called  F&H  (filter  and  hold)  that  allows  the  integration  of  long 
time  constants  in  a reasonably  small  area. 

1.4  Dissertation  Outline 

Chapter  2 presents  the  discrete  olfactory  model  system.  The  results  are  confronted 
with  reported  results  available  in  the  literature,  and  with  the  normal  numerical  integration 
methods.  In  chapter  3 a local  offset  cancellation  method  for  gamma  kernels  is  proposed. 
Gamma  kernels  implemented  with  switch-current  (SI)  techniques,  exhibit  output  offsets 
that  are  strongly  dependent  on  the  time  constant.  The  technique  presented  in  this  chapter 
minimizes  this  effect  for  single  ended  input  and  single  ended  output  signals. 

The  dynamical  part  of  the  Freeman  model  is  the  hardest  to  comply  with.  Implement- 
ing the  slow  dynamics  in  analog  VLSI  with  small  area  and  power  efficiency  is  a challenge. 
Chapter  4 proposes  a novel  class  of  filters,  called  filter  and  hold  (F&H),  that  are  step 
invariant  and  allow  the  integration  of  long  time  constants  with  reasonably  small  area. 

Chapter  5 presents  all  other  components  such  as  the  nonlinearity  and  summing 
nodes,  needed  to  build  a KO  cell.  Chip  measurements  for  KII  cells  are  presented,  and  com- 
pared with  the  DSP  simulator  solutions. 

A multiplexing  method  that  efficiently  allocates  few  resources  among  all  channels  is 
proposed.  Chapter  6 provides  the  concluding  remarks  and  discusses  future  work  direc- 


tions. 


CHAPTER  2 

DISCRETE  NETWORK  IMPLEMENTATION  OF  THE  OLFACTORY  MODEL 

2. 1 Introduction 

Freeman’s  model  is  normally  simulated  using  Runge-Kutta  integration  [23].  This 
integration  procedure  is  time  consuming  and  not  amenable  to  simple  modifications  in  the 
topology.  This  chapter  develops  an  equivalent  digital  model  using  DSP  techniques  at  the 
system  level  (most  results  found  in  this  chapter  were  published  by  Principe,  Tavares,  Har- 
ris and  Freeman  [24]  and  by  Tavares,  Principe  and  Lynn  [25]). 

Discrete-time  system  modeling  has  been  successfully  applied  to  physical  phenom- 
ena which  accept  a linear  model,  such  as  the  vocal  tract  model  in  speech  synthesis  [26]. 
Instead  of  sampling  the  outputs  of  the  continuous-time  model,  this  modeling  approach  dis- 
cretizes the  system  equations  using  the  theory  of  digital  signal  processing.  However,  for 
nonlinear  systems  there  is  no  known  transformation  that  can  map  phase  space  to  a sam- 
pled domain,  like  the  conformal  mapping  does  from  the  S to  the  Z domains  [27].  Nonethe- 
less, here  we  are  interested  in  a very  special  nonlinear  system  built  from  an 
interconnection  of  KO  models  that  possesses  linear  dynamics  followed  by  a smooth  static 
nonlinearity.  It  was  experimentally  verified  that  the  methodology  explained  in  this  chapter 
to  design  equivalent  discrete-time  linear  systems  is  successful  in  preserving  the  general 
dynamical  behavior  of  the  continuous-time  model. 

Equation  (2-1)  shows  the  general  formal  structure  of  the  Kill  network.  The  forcing 
input  in  the  right  hand  side  of  Eq.  (2-1)  represents  the  connections  from  other  similar  KO 


14 


15 


sets  in  the  network,  which  themselves  might  also  receive  excitation  from  this  given  ilh  KO 
set.  The  left  hand  side  of  Eq.  (2-1)  represents  a LTI  (Linear  Time  Invariant)  system. 


l 

a ■ b 


( -\2  ^ 

+ (a  + 0 + a ■ bx^t)  = £ lKijQ(Xj(t),  q)  + K^fj(Q{Xj{t\  q),  /)]  + /, 


\di 
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The  proposed  procedure  to  discretize  Eq.  (2-1)  decomposes  this  equation  as  topol- 
ogy and  dynamics.  The  dynamics  can  be  mapped  with  linear  DSP  techniques  to  the  dis- 
crete-time domain.  The  connecting  structure  between  individual  cells  being  static  is 
preserved,  except  that  delays  are  incorporated  in  the  feedback  pathways  to  avoid  instanta- 
neous time  calculations  (Figure  2-1).  The  feedfoward  connections  do  not  need  to  be 
delayed.  There  are  two  basic  potential  problems  with  this  methodology:  first,  it  assumes 
that  the  continuous  dynamical  system  is  synchronized,  which  is  unrealistic  (although  not 
covered  in  this  work,  there  are  ways  to  mitigate  this  shortcoming  [28]).  Second,  the 
dynamics  between  the  analog  and  discretized  models  may  differ.  Similar  methods  have 
been  applied  to  discretize  the  Hopfield  model  (with  smooth  nonlinearities)  [12,13,28]  and 
the  terminal  dynamics  of  both  (analog  and  discrete)  systems  have  been  shown  equivalent 
[29],  Yet,  the  terminal  dynamics  for  the  KII  set  is  a limit-cycle,  instead  of  a fixed  point  and 
the  inclusion  of  a delay  in  the  feedback  path  could  change  the  frequency  of  oscillation 
between  the  analog  and  the  digital  counterpart.  The  implementation  discussed  here  avoids 
this  problem,  and  experiments  have  shown  that  the  method  is  a excellent  approximation  to 
Runge-Kutta  as  long  as  the  nonlinear  block  is  static  and  that  the  final  dynamics  is  1// type. 

The  proposed  discretization  approach  results  in  a discrete-time  model  that  can  be 
implemented  with  a network  of  dynamical  components  found  in  standard  commercial  neu- 
ral network  packages  or  DSP  simulators.  This  means  that  adding  or  deleting  features  or 
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new  components  to  the  system  is  simple  and  does  not  imply  rewriting  the  global  state 
equations.  The  resulting  digital  system  also  computes  the  output  solutions  in  a sample-by- 
sample basis  which  is  better  fitted  for  real-time  simulations.  These  are  invaluable  charac- 
teristics for  testing  of  the  analog  simulator  presented  in  the  following  chapters. 


Figure  2-1.  Discrete  representation  of  a KI  set  feedback  paths 


2.2  Impulse  Invariant  Transformation 

The  simplest  method  to  discretize  the  local  linear  dynamics  of  the  KO  set  of  Eq.  (2- 

1)  is  to  make  an  impulse  invariant  transformation  [30]  that  preserves  the  system  impulse 
response  shape.  This  characteristic  should,  if  well  controlled,  also  preserve  the  global 
dynamics  because  the  static  part  (topology)  is  smooth  and  is  kept  unchanged  through  the 
mapping.  The  discrete-time  system  impulse  response,  h(nT) , is  found  by  sampling  the 
continuous-time  impulse  response,  h(t),  with  a suitable  sampling  frequency  fs=l/T  (Eq.  (2- 

2) ).  The  spectrum  of  the  sampled  impulse  response  is  constituted  by  replicas  of  the  base- 
band frequency  spectrum,  centered  at  multiples  of  the  sampling  frequency  fs.  Therefore, 
the  method  is  subject  to  aliasing,  but  it  can  be  controlled  because  both  KO  and  Kill  net- 
work dynamics  are  of  l//type.  The  transfer  function  that  results  from  the  invariant  trans- 
formation applied  to  the  left  hand  side  of  Eq.  2-1  is  defined  by  Eq.  (2-3)  where  F(z ) is  the 


forcing  input.. 
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h{nT)  = T-h(nT) 


(2-2) 
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From  observation  of  Eq.  (2-3),  the  impulse  invariant  transformation  already  incor- 
porates the  delay  required  to  avoid  the  instantaneous  computations  caused  by  the  intercon- 
nection feedback  of  the  Kill.  In  this  way  no  extra  delay  is  actually  needed  because  the 
delay  operator  found  in  Eq.  (2-3)  can  be  moved  to  the  feedback  connections. 


Alternatively,  one  can  decompose  the  impulse  response  of  Eq.  (2-3)  over  a set  of 
real  exponentials  which  has  been  called  the  gamma  bases  (also  known  as  the  gamma  ker- 
nels) given  by  Eq.  (2-4)  [31,32] 


The  main  objective  of  such  decomposition  is  to  allow  easy  global  optimization  of 
the  KII  and  Kill  networks  using  methods  such  as  backpropagation  through  time  (BPTT) 
[33],  once  the  input  and  output  signal  examples  are  made  available  in  later  stages  of  the 
research. 

The  impulse  response  of  the  gamma  kernels  (a  cascade  of  low-pass  filters  of  equal 
time  constant)  resembles  many  of  the  signals  collected  or  modeled  in  neurophysiology 
(Figure  2-2)  [34].  The  gamma  kernels  form  a set  of  complete  real  basis  functions,  meaning 
that  any  signal  in  L2  (finite  power)  can  be  decomposed  over  gamma  kernels  with  an  arbi- 
trarily small  error  [32].  The  gamma  kernels  can  be  used  as  delay  operators  in  substitution 
to  the  ideal  delay  operator,  bridging  very  well  continuous  and  discrete-time  domains. 


2.3  Gamma  Basis  Decomposition 


(2-4) 
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Weighting  the  values  of  each  gamma  delay  operator  creates  a generalized  feedforward  fil- 
ter called  the  gamma  filter  [31],  which  is  written  as  Eq.  (2-5).  The  vector  W=[w0  w^.. 
wn]t  is  the  projection  vector.  The  gamma  filter  block  diagram  is  shown  in  Figure  2-3. 

xk(n)  = (l-nj-x^/i-lj  + H xlc_l(n-l) 

x0{n) 

x^n)  (2‘5) 

xN(n) 


Figure  2-2.  Impulse  response  at  different  taps  of  a 5th  order  gamma  filter 
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Figure  2-3.  Gamma  filter  structure 


Decomposing  Eq.  (2-2)  over  the  gamma  basis  follows  the  well-established  system 
identification  framework,  as  represented  in  Figure  2-4  [35].  A white  noise  source  is  fed  to 
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the  sampled  differential  equation  (2-3)  (noted  by  The  same  signal  is  applied  to  the 
gamma  filter  G(z).  The  output  of  these  two  systems  are  subtracted  and  the  resulting  value 
is  used  as  an  error  for  adaptation  of  the  gamma  parameters.  Adaptation  algorithms  have 
been  developed  previously  to  search  p and  the  projection  vector  W [32]. 


Figure  2-4.  System  identification  (ID)  procedure 

The  filter  order  determination  in  the  case  of  Eq.  (2-3)  is  relatively  easy  because  the 
unknown  system  is  decomposed  in  the  set  of  real  exponentials.  To  gain  a better  under- 
standing, the  characteristics  of  the  gamma  kernel  will  be  addressed  next. 

2.3. 1 Gamma  Filter  Stability,  Resolution  and  Depth  of  Memory 

Consider  the  Z transform  of  Eq.  (2-4)  for  M gamma  kernels.  The  transfer  function 
between  the  input  and  the  last  gamma  tap  can  then  be  written  as: 

w - (2-6) 

Therefore,  the  delay  mechanism  for  the  gamma  filter  is  a cascade  of  identical  first 
order  HR  sections  (Figure  2-3).  For  stability  the  gamma  filter  feedback  parameter  has  to 
be  restricted  to  0 < p < 2 . Yet  the  condition  is  very  easy  to  test  since  p is  common  to  all 


kernels  in  the  filter. 
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The  gamma  filter  has  an  infinite  region  of  support,  which  means  that  a low  order  fil- 
ter can  model  long  time  dependencies.  The  region  of  support  of  the  impulse  response  is 
very  important  for  system  identification  and  for  processing  of  time  information,  it  imple- 
ments a short-term  memory  mechanism.  Memory  in  the  present  context  means  how  far  in 
the  past  the  dependencies  are  to  compute  the  present  output.  The  memory  depth  for  the 
gamma  filter  with  M taps  is  [32]: 

D = - (2-7) 

Gamma  filters  are  able  to  trade  memory  depth  with  resolution.  In  fact,  defining  M as 
the  order  of  the  filter,  D the  memory  depth  given  by  Eq.  (2-7),  and  R the  time  resolution, 
we  can  write  for  the  gamma  filter  M = D ■ R . In  an  FIR  filter,  the  memory  depth  is  the 
filter  order  M.  From  Eq.  (2-7)  we  have  the  extra  feedback  parameter  |i  to  change  the  mem- 
ory depth  of  the  gamma  filter.  However,  there  is  a trade-off  between  time  resolution  and 
memory  depth,  which  is  controlled  by  the  order  of  the  system.  The  resolution  is  problem 
dependent  and  most  of  the  time  the  trade-off  is  resolved  heuristically.  In  the  present 
dynamic  system  modeling,  the  lowest  order  was  selected  due  to  analog  VLSI  implementa- 
tion constraints. 

2.4  Differential  Equation  Discretization  Results 
From  biological  evidence  the  parameters  a and  b assume  the  values  220/s  and  720/s 
[1],  respectively.  Since  the  poles  are  real,  a good  fit  can  be  obtained  with  a second  order 
gamma  filter.  The  sampling  frequency  1/T  was  chosen  as  20  times  larger  than  the  maxi- 
mum frequency  pole.  Figure  2-5  represents  the  impulse  invariant  system  response  to  an 
impulse.  The  gamma  filter  approximation  of  the  sampled  differential  equation  is  also  plot- 


21 


ted.  The  resulting  match  is  very  good,  although  the  approximation  filter  has  only  a double 
pole  at  (1-p).  Table  2-1  summarizes  the  gamma  filter  parameters  values  found  using  the 
discussed  system  ID  approach. 


Table  2-1.  Gamma  parameters 
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Figure  2-5.  Gamma  basis  approximation  of  the  impulse  response  of  Eq.  (2-3) 

2.4.1  Dispersive  Delays  Discretization 

As  discussed  earlier,  the  time  dispersion  was  introduced  in  the  Kill  network  to 
model  the  different  axonal  interconnection  lengths  and  thicknesses.  These  functions  can 


be  modeled  as  in  Eq.  (2-8)  [3] 


22 


f(Q(x,q),nT)  = —~r  £ Q(x,  q) 

1 S 1 € 


(2-8) 


which  can  be  rewritten  in  a convolution  form  as: 


f(Q(x,  q),  nT)  = Q(x,q)*-±-(u{nT-Ts)-u(nT-Te))  = 

* p a 


S € 


(2-9) 


Q(x,  q)  • Dd(nT) 


where  • denotes  the  convolution  and  u(nT)  is  the  step  function.  Equation  (2-8)  repre- 
sents a low-pass  FIR  filter  in  discrete-time  and  Dd(nT)  is  recognized  as  a linear  phase  filter 
of  type  I or  II  depending  if  the  number  of  Dd(nT)  samples  is  even  or  odd,  respectively.  To 
be  more  biologically  realistic  the  filter  should  have  nonlinear  phase.  A simple  low-pass 
HR  system,  such  as  a first  order  gamma  kernel,  has  nonlinear  phase  and  so  it  implements  a 
more  realistic  dispersive  delay. 

Time  dispersion  can  be  analytically  calculated  using  the  memory  depth  defined  in 
Eq.  (2-7).  In  Eq.  (2-9),  DJqiT)  can  be  interpreted  as  a memory  structure  with  a time  depth 
Ts-Te+ 1.  Then,  considering  a gamma  filter  of  some  order,  the  parameter  p can  be  calcu- 
lated making  D =(Ts-Te+l)/T  in  Eq.  (2-7).  The  order  of  the  gamma  dispersive  function  will 
impact  on  resolution.  From  experimental  results,  a second  order  gamma  filter  (W=[0  0 
1]T)  is  shown  to  be  sufficient.  The  resulting  dispersive  gamma  functions  impulse 
responses  are  plotted  in  Figure  2-6. 
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Figure  2-6.  Delay  response  for  different  dispersive  delays  of  the  KHI  model 
2.4.2  NeuroSolutions  Example 

After  discretization,  any  software  package  (DSP  or  neural  networks)  or  even  hard- 
ware simulators  can  be  utilized  in  the  simulation.  The  environment  used  for  this  task  is  a 
commercial  neural  network  package  called  “NeuroSolutions”  [36].  The  software  has  all 
the  basic  building  blocks  that  are  needed  to  construct  the  Katchalsky  sets  and  the  disper- 
sive delays.  The  user  interface  enables  the  creation  of  the  topologies  for  each  set  using  an 
icon-based  interface.  Figure  2-7  shows  the  KII  setup  breadboard  in  NeuroSolutions  where 
the  different  graphical  icons  can  be  identified  by  the  labels. 

NeuroSolutions  is  an  object-oriented  programming  environment  for  neural  networks 
that  is  based  on  a data  flow  model  of  computations.  There  are  two  basic  families  in  Neuro- 
solutions: the  axons  (bubble  icons  in  Figure  2-7)  where  the  nonlinearities  and  short-term 
memories  are  implemented,  and  the  synapses  where  the  sum  of  products  are  calculated 
(interconnecting  elements).  The  sum  of  products  can  be  extended  over  time  giving  rise  to 
adaptive  filters.  By  interconnecting  different  axons  and  synapses,  the  user  is  actually  giv- 
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ing  indications  to  NeuroSolutions  how  to  build  the  code  and  run  it.  In  each  icon  is  defined 
the  number  of  elements  that  it  contains  (e.g.,  for  the  nonlinearity  we  would  define  4 ele- 
ments for  a single  KII  channel  or  16  for  four  channel  KII).  Interconnecting  different  axons 
through  synapses  one  is  able  to  build  a network.  Because  our  discrete-time  system  is  made 
of  components  those  components  can  be  represented  by  an  icon  (axon  or  synapse)  in  Neu- 
roSolutions. For  instance,  to  implement  the  KII  set,  equations  (1-2),  (2-5)  and  the  structure 
shown  in  Figure  1-6  are  needed.  In  these  equations  we  have  a second  order  recursive  filer 
that  can  be  implemented  in  NeuroSolutions  as  the  gamma  axon  with  two  taps  (the  gamma 
delay)  followed  by  a synapse  (the  weights),  and  feedback  (implemented  by  another  syn- 
apse linking  the  output  of  the  filter  to  its  input).  The  output  of  the  dynamic  part  is  passed 
through  a nonlinearity  that  can  be  implemented  by  another  axon.  The  program  provides 
the  most  common  nonlinearities  found  in  neural  networks,  but  does  not  have  a nonsym- 
metric  nonlinearity  required  by  Freeman’s  model.  However,  the  nonlinear  axon  can  be 
configured  to  any  nonlinearity  by  writing  a very  simple  DLL  (dynamic  Link  Library).  So 
we  programmed  the  nonlinearity  of  Eq.  (1-2).  Once  the  KII  set  is  created,  we  need  a KII 
network,  which  is  obtained  by  fully  interconnecting  KII  sets.  NeuroSolutions  enables  us  to 
create  vectors  of  processing  elements,  so  we  have  just  to  define  how  many  KII  sets  are 
needed.  The  iconic  representation  does  not  change,  but  the  feedback  connectivity  is  sparse 
(hence  the  arbitrary  synapse  must  be  used).  In  order  to  implement  the  fully  interconnectiv- 
ity, we  have  to  use  another  synapse  connecting  the  output  of  each  KII  to  the  input  of  all  the 
others.  The  input  to  the  network  is  implemented  by  an  axon  with  a wave  generator,  to  the 
left  of  the  gamma  delay  line.  Figure  2-7  shows  how  these  blocks  are  laid  on  the  bread- 
board. NeuroSolutions  allows  for  probing  of  the  activities  anywhere  in  the  network.  In  this 
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case  we  place  a data  buffer  and  a scope  at  the  output  of  the  network  to  observe  the  output 
of  the  KII  network  (the  output  of  the  filter),  once  an  input  is  applied. 

Now  adding  or  removing  KII  cells  to  this  system  is  straight  forward  and  is  only  a 
question  of  network  and  program  parameter  setting  (e.g.,  number  of  repeated  cells).  To 
simply  loading  the  parameters  of  complex  breadboards  we  utilized  another  feature  of  Neu- 
roSolutions  that  allows  the  loading  of  weights  from  an  external  file. 

It  should  be  noted  that  almost  no  programming  was  required  to  set  up  the  bread- 
board and  once  again,  this  is  possible  because  of  our  system  level  discretization  where  the 
final  model  can  be  dealt  as  a standard  digital  artificial  neuron  network  (ANN)  model.  This 
Neurosolutions  example  shows  clearly  the  flexibility  gained  with  a discrete  implementa- 
tion. A 20  channel  or  a 200  channel  network  uses  the  same  breadboard  because  only  the 
indication  of  how  many  elements  and  the  corresponding  parameter  values  are  needed  to 
actually  change  the  network. 


Full  KII  Model 


Figure  2-7.  The  KII  NeuroSolutions  breadboard 
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2.4.3  Digital  Simulation  Results 

Figure  2-8  shows  a comparison  of  the  KII  output  spectrum  to  a “high”  input 
obtained  using  Runge-Kutta  (ODE45  in  Matlab  [37])  and  our  modeling  method.  The  KII 
system  response  was  simulated  with  an  input  square  wave  with  an  amplitude  of  6 (arbi- 
trary units)  when  excitation  is  present,  and  zero  otherwise.  The  parameter  set  is  summa- 
rized in  Table  2-2  where  KMG  are  the  weights  between  the  mitral  (M)  and  granular  cell 
(G)  denoted  by  M and  G in  Figure  1-8. 


Table  2-2.  KII  Parameter  set 


kmm 

0.3 

kmg 

5 

Kgm 

0.2 

kgg 

0.25 

The  magnitude  spectrum  was  computed  using  the  window  method.  For  Figure  2-8a, 
we  took  6 seconds  simulation  time  with  a window  of  12,000  points,  20%  overlap  and  11 
averages.  For  Figure  2-8b  we  performed  a 19  seconds  simulation  time  with  2,048  points 
window,  20%  overlap  and  40  averages.  As  can  be  observed,  the  match  between  the 
Runge-Kutta  spectrum  and  our  methodology  is  very  good. 

Table  2-3  summarizes  the  number  of  flops  taken  by  both  methods  (DSP  and  Runge- 
Kutta)  to  compare  the  computational  efficiency.  It  is  clear  that  the  DSP  technique  outper- 
forms the  higher  level  differential  equation  solver.  It  should  be  emphasized  that  these 
results  are  for  a free  running  Runge-Kutta  method  (i.e.,  the  program  is  allowed  to  automat- 
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ically  adapt  the  best  time  step).  If  the  same  time  resolution  is  forced  on  both  methods  then 
the  differences  become  considerably  more  noticeable. 


Frequency  (Hz) 


a)  b) 

Figure  2-8.  FFT  comparison  of  KII  output  spectrum  using  Runge-Kutta  and  our  discretiza- 
tion method,  a)  T = 1/(720  x 20) ; b)  T = 2 • ti/(720  x 20) 


Adding  extra  delays  on  the  feedback  paths  alters  the  signal’s  frequency  content.  In 
dynamical  terms,  an  extra  delay  (or  more)  changes  the  order  of  the  system.  This  change 
has  obvious  repercussions  on  the  frequency  spectrum  since  the  system  poles  will  move.  A 
simulation  example  is  shown  in  Figure  2-9.  The  consequence  of  a single  extra  delay  is  a 
frequency  shift. 


Table  2-3.  Number  of  flops  comparison 


DSP  Sampling  time 

T = 1/(20-720)) 

T = 2ji/(20-720)) 

Simulation  Time 

6 seconds  of  data 

6 seconds  of  data 

Runge-Kutta 

15  Million  flops 

15  Million  flops 

DSP 

12  Million  flops 

1 Million  flops 
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Figure  2-9.  DSP  result  with  two  delays  in  the  feedback  paths 
2.4.4  The  KII  and  Kill  Network  Results 

A simulation  is  performed  for  a N=20  channels  KII  network  with  5 patterns  stored 
(Table  2-4),  set  according  to  the  modified  Hebbian  rule  discussed  earlier.  The  results 
shown  are  for  the  recall  of  pattern  5. 


Table  2-4.  Patterns  Stored 


_ 

Pattern  I 

10000100001000010000 

Pattern  2 

001 10001000100000010 

Pattern  3 

01001000000010000000 

Pattern  4 

00000010000000001000 

Pattern  5 

000000001  10001000101 

Figure  2-10a  shows  that  an  input  excitation  drives  the  system  into  a limit-cycle  that 
lasts  while  the  input  is  applied.  Figure  2- 10b  shows  the  system  trajectory  with  the  chang- 
ing input.  As  the  input  rises,  the  system’s  trajectory  moves  away  from  the  origin  to  a large 
limit-cycle  centered  afar  from  the  origin.  It  stays  with  “circular”  shape  for  the  duration  of 
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the  input,  and  returns  to  zero  when  the  input  vanishes.  The  phase  plot  resembles  a Shilni- 
kov  singularity,  but  the  local  characteristics  of  the  unstable  point  need  to  be  investigated 
further  [10]. 


Channel  19 


Figure  2-10.  Time  series  of  KII  with  a square  input  and  phase  plot,  a)  Response  to  a pulse; 

b)  Phase  plot 

Figure  2-11  shows  the  20  channel  KII  network  outputs  after  a noisy  representation 
of  pattern  5 (14th  and  15th  bits  flipped)  is  applied  (now  the  input  has  a maximum  magni- 
tude of  2).  As  expected,  channels  that  have  a “1”  at  the  input  oscillate  with  larger  magni- 
tude. However,  channel  14  can  be  still  recognized  as  a “1”  in  spite  of  the  fact  that  at  its 
input  a “0”  was  applied.  If  only  the  steady-state  oscillation  energy  is  considered,  and  a cor- 
rect energy  threshold  is  used,  channel  15  can  be  set  as  a “0”.  Hence,  the  right  pattern  5 
association  is  retrieved  even  with  the  noisy  input.  The  information  output  is  then  coded  in 
the  AM  oscillation  that  Freeman  describes  in  the  OB  of  the  rabbit  following  a sniff. 


The  interesting  property  of  this  output  is  that  it  is  transient  in  time,  disappearing 
when  the  input  vanishes.  This  behavior  is  very  different  from  Hopfield  networks,  where 
the  system  dynamics  stay  in  the  fixed  point  after  the  input  is  removed.  Extra  energy  would 
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have  to  be  supplied  to  the  system  to  get  away  from  the  fixed  point,  while  here  the  KII  net- 
work is  always  ready  for  real  time  processing  of  temporal  patterns. 

The  Kill  network  was  constructed  in  NeuroSolutions  with  only  N=8  channels  in  the 
OB  layer  because  now  the  simulation  takes  much  longer  to  find  the  solutions.  Table  2-5 
summarizes  the  parameter  set  used  for  the  simulation.  All  the  results  were  generated  for 
the  recall  of  pattern  2.  The  input  is  a smooth  rising  pulse  within  the  values  of  2 and  8 as 
specified  in  [3]. 
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Figure  2-11.  KII  20  channel  network  response  to  input  pattern  5 (Channel 

response(“Input”)) 
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Table  2-5.  Parameters  set  for  the  Kill  network  simulation  (Figure  1-8) 


External  Interconnections 

[Kmp;  Kem;  Kam;  Kcb;  Kbc]~ 
[0.5;  1.0;  1.0;  1.5;  1.0] 
[KpP;  Kmm_h;  Kmm  l;  Kgg]= 
[0.2;  4;  0.5;  1.5] 

OB  Layer  KII 

1kmm’>  kmg!  Kgm?  kgg1= 
[0.25;  1.5;  1.5;  1.8] 

AON  Layer  KII 

[KEE;  Kei;  K[E;  Kn]= 
[1.5;  1.5;  1.5;  1.8] 

PC  Layer  KII 

1kaa5  Kab;  Kba;  kbb1= 
[0.25;  1.4;  1.4;  1.8] 

Gains  Associated  with  dispersive 
delays  (Kj  Associated  with  ft(.)) 

[Ki ; K2;  K3;  K4]= 
[1.6;  0.5;  2;  1.5] 

Te  of  equation  13 

[Tel'>  Te2?  Tj3;  Te4]= 
[11;  15;  12;  24] 

Ts  of  equation  13 

[T,i;  Ts2;  T^; 

[20;  26;  25;  39] 

Patterns  Stored 

PatternX  _ 10010010 
Pattern2  0 1 0 0 1 0 0 1 

In  the  full  Kill  system  we  have  many  possible  probe  points.  Let  us  start  by  analyz- 
ing the  resting  state  at  the  PG,  OB,  AON  and  PC  layers.  If  the  time  signals  are  observed  at 
any  of  these  locations,  in  the  absence  of  input,  random  fluctuations  of  a quasi-periodic 
activity  will  be  noticed  resembling  the  electroencephalogram’s  background  activity.  When 
the  activity  is  plotted  as  phase  plots  between  the  inhibitory  and  excitatory  states  (Figure  2- 
12),  we  see  phase  plots  that  resemble  strange  attractors  of  different  shapes  across  the  four 
layers.  Therefore  the  Kill  seems  to  have  a high-order  singularity  producing  nonconver- 
gent  dynamics  compatible  with  a chaotic  attractor.  Simple  power  spectrum  estimation  of 
the  time  series  generated  at  the  AON  (El  state)  shows  clearly  a l//type  of  spectrum  that  is 
once  again  compatible  with  a self  similar  attractor  (Figure  2-13). 
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PC 


PG  (Channel  2)/EC 


Figure  2-12.  Phase  plots  at  different  layers  of  the  Kill  network  (no  excitation) 


Figure  2-13.  AON  fast  fourier  transform  (FFT)  with  no  excitation 
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Let  us  now  turn  to  the  OB  layer  and  analyze  the  response  to  a pulse  input.  Figure  2- 
14  shows  the  time  series  for  the  recall  of  pattern  two.  Notice  that  the  response  of  the  chan- 
nels where  the  “high”  level  of  the  input  was  stored  do  indeed  show  a DC  offset  during  the 
time  the  pulse  is  applied.  An  increase  in  oscillatory  amplitude  during  the  pulse  was  also 
expected.  A system  optimization  using  real  data  should  find  better  parameters  solving  this 
problem.  When  a phase  plot  is  created  using  the  excitatory  Ml  and  inhibitory  G1  states  of 
channel  2,  it  is  clear  (Figure  2- 15a)  that  the  basal  attractor  (for  the  “off’  input)  changes  to 
a “wing”  when  the  input  switches  to  a high  amplitude  (“on”  input).  Channels  that  corre- 
spond a stored  pattern,  oscillate  in  perfect  synchronization  (Figure  2- 15b  and  c)  and  share 
the  same  basal  state  evolution.  This  is  also  reported  by  Freeman  [3].  However,  channels 
belonging  to  different  templates  oscillate  with  different  incommensurable  phases  (Figure 
2-15d).  It  should  be  referenced  however,  that  in  the  beginning  of  the  simulation  they  start 
in  phase  as  shown  in  Figure  2-16,  but  lose  synchrony  very  quickly  thereafter.  Freeman 
states  that  this  lack  of  coherence  is  not  apparent  in  the  signals  collected  from  the  rabbit 
bulb  nor  in  analog  implementations  of  the  model.  He  states  that  it  corresponds  to  the 
breakdown  of  the  chaotic  attractor  possibly  due  to  quantization  errors  that  create  limit- 
cycles  in  phase  space  [38].  This  behavior  indicates,  that  when  excited,  the  Kill  system 
undergoes  a transition  from  the  basal  to  a different  nonconvergent  behavior  characteristic 
of  the  pattern  being  recalled.  When  the  excitation  vanishes  the  system  always  returns  to 
the  initial  attractor  (Figure  2-15).  The  “on”  channels  are  distinguishable  by  the  higher  off- 
set and  signal  dynamics  (Figure  2-15).  All  these  results  are  consistent  with  Freeman’s 
reports  using  Runge-Kutta  numerical  methods  [3],  while  here  we  use  our  discretization  of 
the  linear  part  of  the  model  dynamics. 
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Figure  2-14.  Time  series  for  the  recall  of  pattern  2 [channel  (“input”)] 
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OB  - Template  synchronization  (pattern  1) 
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Figure  2-15.  Behavior  with  input  “Off-On-Off’  cycles 
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Figure  2-16.  OB  channel  2 and  4 time  series 
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2.5  Quantization  Effects:  Some  Insights 


The  previous  sections  discussed  a discrete-time  mapping  method  for  the  olfactory 
model  using  DSP  techniques.  The  resulting  digital  version  utilized  the  same  parameters  as 
the  continuous-time  model  and  provided  identical  results  as  the  ones  reported  earlier  by 
Freeman  using  the  Runge-Kutta  methods.  Nevertheless,  Freeman  has  expressed  concern 
relative  to  the  stability  of  chaotic  attractors  caused  by  quantization  intrinsic  to  digital 
implementations  [19,20].  Round-off  noise  (amplitude  quantization)  is  reported  to  be  the 
biggest  source  of  instability.  The  phenomenon  is  related  with  attractor  crowding  [21,22] 
which  occurs  when  the  attractor  “size”  is  in  the  order  of  the  least  significant  bits  of  a com- 
puter word  length.  To  express  better  what  is  involved,  let  us  take  an  example  and  consider 
a widely  used  chaotic  system  formulated  in  (2-10)  and  called  the  Lorenz  system  [8]. 


The  ct,  b,  r >0  and  are  parameters  of  the  system.  Let  us  use  ct=10,  b=8/3,  r=28  [11] 
which  produce  chaotic  dynamics.  Euler  integration  is  used  to  find  the  solutions.  Although 
Euler  numerical  integration  is  a poorer  approximation  than  Runge-Kutta,  it  is  simpler  to 
implement  and  control.  Equation  (2-11)  is  the  numerical  state  space  representation  of  (2- 


(0  = <*(y(0-x(0) 


^y(0  = r-x(t)-y(t)-x(t)-z(t ) 
^z(t)  = x(t)  ■ y(t)  - b ■ z(t) 


(2-10) 


x(n  + 1) -x{n) 
T 


x(n  + 1)  = x{n)  + T-  o • [y(n)  -x(f)] 

• y(n  + 1)  = y(n)  + T • [r  • x(n) -y(n) -x(n)  ■ z(n )] 
z(n  + 1)  = z(n)  + T-  [*(«)  • y(n)  - b ■ z(n)] 


(2-11) 
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The  value  T was  chosen  to  be  0.01.  From  the  simulation  of  Eq.  (2-11)  and  measur- 
ing the  states  maximum  and  minimum  values,  a certain  number  of  quantizing  levels  were 
created.  This  is  a way  to  bring  the  numerical  precision  up  to  the  size  of  the  attractor.  The 
quantizing  levels  will  define  the  different  possible  values  that  Eq.  (2-11)  mathematical 
operations  may  assume.  Taking  now  into  account  the  quantization  function  quant(.)  equa- 
tion (2-11)  takes  the  form  of  Eq.  (2-12). 

x (n  + 1)  = x(n)  + T ■ quant[a  ■ quant[y(n) -*(/)]] 

•y(n+l)  = y(n)  + Tquant[quant[r-x(n)]  + quant[-y(n)-quant[x(n)-z(n)]]]  (2-12) 

z(h+1)  = z(n)  + T ■ quant[quant[x(n)  ■ y(n)]-quant[b  ■ z(n)]] 

Factors  directly  related  with  time  dynamics  are  not  quantized.  This  prevents  the  sys- 
tem to  be  to  strongly  coupled  to  the  quantization.  All  simulations  have  an  initial  condition 
defined  as  [x,y,z]=  [0  30  0]. 

Figure  2-17  represents  two  phase  plots.  One  for  a solution  to  Eq.  (2-11)  and  the 
other  for  Eq.  (2-12)  quantized  with  8 levels.  Figure  2-18  shows  x(t ) time  series.  The  simu- 
lation results  show  clearly  that  under  quantization,  a long  term  non-predictive  system  like 
(2-12)  can  become  of  low  order,  namely  limit-cycle. 

We  further  tried  32  quantization  levels.  The  results  are  shown  in  Figure  2-19  and 
Figure  2-20.  It  shows  now  that  a nonconvergent  system  can  become  asymptotically  stable. 
In  this  case  the  quantization  has  created  a strong  basin  around  the  zero  fixed  point. 

Quantization  changes  dynamics  by  introducing  extra  nonlinear  effects.  So  the  more 
“analog”  the  mathematical  operations  resemble  the  more  the  system  “disorganizes”  and 
then  more  chaotic  is  its  behavior.  Quantization  seems  to  be  a way  to  control  chaos  by  lim- 
iting the  number  of  possible  trajectories  in  state  space.  The  experiment  shows  that  in  a 
nonlinear  system  the  coarse  quantization  should  not  be  considered  as  an  independent  noise 
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source  [30],  but  instead  needs  to  be  modeled  as  an  extra  nonlinear  function  embedded  in 
the  original  system  function. 

Figures  2-17  to  2-20  demonstrate  that  the  trajectory  gets  trapped  in  some  region  dur- 
ing its  history.  This  quantization  phenomenon  has  been  also  reported  with  the  Kill  model 
[20].  One  solution  that  seems  to  stabilize  the  chaotic  attractor  is  to  add  white  noise  to  spe- 
cific points  of  the  network  [19]. 


Euler  approximation  of  (4.1) 


Figure  2-17.  Comparison  of  a “non”  quantized  with  a 8 level  quantization  Lorenz  system 

phase  plots 
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Time  series  Euler  approximation 


Figure  2-18.  Comparison  of  a “non”  quantized  with  a 8 level  quantization  Lorenz  system 

time  series 


Euler  approximation  of  (4.1) 


Figure  2-19.  Comparison  of  a “non”  quantized  with  a 32  level  quantization  Lorenz  system 

phase  plots 
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Time  series  Euler  approximation 


Figure  2-20.  Comparison  of  a “non”  quantized  with  a 32  level  quantization  Lorenz  system 

phase  plots 

Taking  into  consideration  the  above  results  we  conclude  that  a discrete-time  system 
that  uses  full  analog  calculations  will  be  realistic  and  exempt  of  attractor  crowding  prob- 
lems. Furthermore,  according  to  previous  Kill  reported  results,  the  natural  noise  inherent 
to  any  real  system  will  actually  work  as  a chaotic  “stabilizer”  [19]. 

2.6  Analog  VLSI  Implementation — What  to  Gain? 

Round-off  noise  inherent  to  digital  computers  is,  in  principle,  a source  of  problems 
for  complex  systems  composed  of  many  coupled  oscillators.  By  itself  the  round-off  noise 
can  be  reduced  as  much  as  required  using  more  and  more  bits,  but  eventually  such  proce- 
dure becomes  impractical.  An  obvious  solution  is  analog  computing.  Due  to  the  natural 
effective  infinite  amplitude  resolution  the  round-off  problem  is  immediately  solved.  An 
electronic  analog  implementation  has  further  intrinsic  noise  that  can  help  stabilize  the  cha- 
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otic  attarctors.  Furthermore  the  computation  is  parallel  which  consequently  will  be  more 
efficient.  Nevertheless,  in  terms  of  VLSI  implementation,  the  Kill  network  represents  a 
real  challenge,  mainly  because  the  number  of  connections  increases  proportional  to  N (N- 
number  of  channels).  They  can  actually  grow  so  big  to  turn  impractical  the  design  of  a 
chip.  To  overcome  the  massive  interconnecting  network,  multiplexing  can  be  employed  to 
scale  down  the  number  of  interconnections  proportional  to  N. 

In  a continuous-time  system  the  use  of  multiplexing  implies  time  discretization  of 
signals.  In  order  to  keep  a continuous-time  resolution,  the  output  of  the  multiplexers  must 
be  filtered,  which  represents  an  extra  VLSI  implementation  difficulty.  Our  approach  is  to 
depart  from  continuous-time  system  implementation  into  a mixed  discrete/continuous- 
time processing  framework.  In  this  environment  the  magnitudes  are  fully  analog,  the  time 
resolution  can  be  controlled,  and  multiplexing  comes  very  naturally. 

2.7  Summary 

This  chapter  presented  a DSP  mapping  procedure  to  model  the  olfactory  system. 
The  impulse-invariant  transformation,  although  a very  simple  method,  is  subject  to  alias- 
ing. However,  since  the  local  dynamics  are  low-pass,  a suitable  sampling  rate  minimizes 
the  aliasing  effect.  Furthermore,  impulse-invariant  preserves  the  impulse  response  of  the 
original  filter  which  is  important  if  the  signal’s  shapes  are  to  be  preserved.  Another  benefi- 
cial feature  of  the  transformation  was  the  input  delay  element.  This  delay  was  placed  at  the 
feedback  connectivity  level  sparing  the  use  of  extra  delays  with  the  consequent  frequency 
shift.  Results  have  shown  that  the  DSP  method  is  more  computationally  efficient  than 
Runge-Kutta  with  similar  outcomes.  It  also  opens  new  directions  for  analog  hardware 


implementations. 


CHAPTER  3 

FEEDBACK  INDEPENDENT  OFFSET  CANCELLATION  SCHEME  FOR  SI  GAMMA 

KERNELS 

3.1  Introduction 

Switch-current  circuits  [42,43]  are  a possible  method  to  avoid  low  voltage  problems 
through  operation  in  the  current  domain.  The  low  voltage  operation  requirements  made  by 
VLSI  digital  systems  makes  the  design  of  voltage-mode  circuits  with  high  linearity  and 
dynamic  range  rather  difficult.  To  avoid  large  voltage  swings,  a low  impedance  analog  cir- 
cuit is  used  with  current  as  the  signal  instead  of  the  voltage.  These  can  operate  at  lower 
power  supplies  because  the  current  flows  through  low  impedance  nodes  which  in  turn  will 
have  associated  small  voltage  swings  [43],  This  factor  also  impacts  on  frequency  opera- 
tion because  lower  impedance  in  the  signal  path  means  a wider  frequency  band.  Further- 
more, SI  technique  does  not  require  linear  capacitors  thus,  they  are  suitable  for  standard 
digital  technologies. 

Using  current  mode  processing,  also  allows  complex  computations  to  be  accom- 
plished with  relatively  simple  circuits  using  the  translinear  principle  [43].  Originally, 
translinear  circuits  were  employed  with  bipolar  transistors.  However,  translinear  principle 
can  also  be  attained  with  MOS  working  in  subthreshold  [44],  or  even  in  above  threshold 
[45,46].  The  former  uses  the  exponential  relationship  between  the  drain  current  and  the 
gate — source  voltage.  The  latter  uses  the  square  law  characteristic.  A well  known  example 
of  a circuit  that  uses  this  principle  is  the  Gilbert  multiplier  [47],  An  example  of  a full  cur- 
rent mode  multiplier  using  translinear  principle  was  proposed  by  Wiegerink  [48].  Other 
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good  areas  of  applications  are  in  artificial  neural  networks  [7,49]  where  transcendental 
equations  are  often  needed. 

From  the  above  considerations,  there  are  strong  arguments  to  pursue  current  as  the 
computational  signal  environment.  Given  that  a discrete-time  approach  is  preferred  for  the 
olfactory  model,  the  next  item  to  be  studied  is  the  SI  (switch-current)  implementation  of 
the  KO  second  order  dynamics. 

3.2  The  SI  Gamma  Filter 

Switch-capacitor  (SC)  [39^11]  and  switch-current  (SI)  [42,43]  circuits  are  the  most 
common  discrete-time  techniques  used  for  the  design  of  analog  VLSI  filters  and  can  be 
used  to  implement  the  KO  dynamics  [50].  A survey  on  SC  and  SI  filters  can  be  found  in 
Appendix  A.  In  this  appendix  the  most  common  nonideal  effects  and  methods  to  improve 
performance  are  covered  and  an  SC  programmable  gamma  filter,  is  also  presented.  How- 
ever, the  same  filter  implemented  with  SI  circuits,  show  strong  offset  dependence  with  the 
time  constant.  In  fact,  if  no  type  of  offset  compensation  is  employed,  the  final  offset  may 
prevent  the  circuit  from  operating  properly. 

Figure  3-1  shows  a gamma  kernel  schematic  using  SI  technique.  Transistors  Mj, 
M2,  M3  and  M4,  represent  the  delay  element.  Transistor  M5  scales  the  output  by  1 1 (time 
constant),  which  is  then  inverted  through  M6  and  M10  and  added  to  the  scaled  input  cur- 
rent |i  ■ ik_  j . The  resulting  filter  function  is  the  gamma  kernel  defined  by  Eq.  (3-1). 


ik{nT)  = (1  -\L)  • ik[(n  - 1)T]  + ^-i*.1[(n- 


(3-D 
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Figure  3-1.  The  SI  gamma  kernel  (a:b  means  relative  transistor  ratios  in  the  loop) 


All  the  methods  to  overcome  nonideal  effects  inherent  to  SI  circuits  presented  in  the 
appendix  A,  can  be  applied  to  the  gamma  filter  in  Figure  3-1  with  minor  changes.  Since 
power  is  a concern  maybe  even  a class  AB  Si-memory  cell  could  be  employed  [51-53]. 
Nonetheless  no  method  is  totally  effective  and  always  a residual  DC  offset  is  present.  In 
most  applications  this  might  not  be  a concern,  but  for  a discrete  gamma  kernel  the  residual 
offset  is  amplified  by  the  loop  gain,  and  the  circuit  will  not  work  properly.  For  a better 
understanding,  assume  a first  order  gamma  kernel  with  a constant  value,  Xof,  added  at 
some  point  of  the  feedback  loop  as  shown  in  Figure  3-2a  (block  diagram  representation  of 
Figure  3-1).  The  Xof  value  represents  all  open-loop  offset  contributions  measured  accord- 
ing to  Figure  3-2b.  All  components  in  Figure  3-2a  are  then  considered  ideal  and  Eq.  (3-2) 
defines  the  system  difference  equation  with  Xk_  ,(«)  = 0 . 


Xk(n)  = (l-pi-X^n-D  + X^ 


(3-2) 
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Figure  3-2.  Gamma  kernel  loop  with  the  xof  representing  all  offset  contributions  through- 
out the  loop 


The  final  steady-state  output  offset  can  be  determined  considering  Eq.  (3-3),  where 
Xkof  is  a constant  and  represents  the  final  output  value.  Substituting  Eq.  (3-3)  into  Eq.  (3- 
2)  and  after  a minor  manipulation,  the  final  steady-state  offset  can  be  defined  by  Eq.(3-4). 

[Xt(n)  = Xt(M-l)]|^oo  = Xkof  (3-3) 


(3-4) 


According  to  Eq.  (3-4),  the  closed  loop  offset  is  linearly  dependent  upon  the  open- 
loop  offset  and  inversely  proportional  to  the  feedback  parameter.  Minimizing  Xkof  means 
decreasing  Xof  by  using  the  techniques  presented  in  the  literature,  but  due  to  the  special 
topology  of  the  gamma  kernel,  it  also  requires  some  extra  attention.  In  fact,  with  | x less 
than  one,  the  steady-state  offset  is  an  amplified  version  of  the  original  open-loop  offset. 
Depending  on  Xof  and/or  p.  values,  the  final  offset  may  become  extremely  high  implying 
that  some  form  of  feedback  independent  offset  cancellation  scheme  is  required.  Figure  3-3 
shows  a Matlab  simulation  of  Figure  3-2a  for  4 and  = 0.1  (the  simulation  limit 

value  matches  the  result  given  by  Eq.  (3-4)).  This  example  shows  that  an  SI  circuit  with 
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lOOjiA  bias  current,  would  lose  almost  half  of  its  dynamic  range  with  an  accumulated  cur- 
rent-loop offset  of  only  4%  (4[iA)  of  the  bias  current. 


Figure  3-3.  Gamma  kernel  response  with  zero  input  and  finite  offset  (X0j  = 4 and 

\L  = 0.1) 

A balanced  fully  differential  version  of  the  gamma  kernel  could,  in  principle,  avoid 
partially  this  offset  magnification.  However,  small  differential  offsets  would  again  be 
magnified.  Furthermore,  when  chip  area  needs  to  be  optimized,  such  as  with  the  olfactory 
model,  silicon  area  should  always  be  reduced  to  a minimum  and  full  differential  circuits 
are  less  optimal  in  this  respect  because  they  need  twice  the  resources  and  connections  of  a 
single-ended  system. 

3.3  Proposed  Feedback  Independent  Cancellation  Scheme  for  a Gamma  Kernel 

The  method  suggested  in  this  section  seeks  to  make  the  close  loop  offset  equal  to  the 
open  loop  offset,  by  using  a three  step  procedure.  The  total  offset  in  the  loop  is  probed, 
externally  memorized,  and  later  subtracted  from  the  signal  path.  To  accomplish  cancella- 
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tion  a three  phase  non-overlapping  clock  plus  a reference  clock  are  needed.  Figure  3-4 
shows  the  clock  diagram. 
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Figure  3-4.  New  local  offset  cancellation  clock  diagram 


The  input  signal  must  be  interleaved  with  a zero  input  reference  to  probe  the  offset. 
The  zero  input  reference  measures  the  offset  around  the  loop  and  is  memorized  to  be  later 
subtracted  when  the  signal  input  is  applied.  Both  the  signal  and  reference  should  never 
overlap  otherwise  the  signal  could  be  subtracted  to  itself  causing  errors.  Thus,  two  orthog- 
onal signal  paths  are  created  duplicating  the  delay  circuit  elements  (Figure  3-5).  The  input 
signal  will  flow  through  one  path  during  phase  1 (<Fj)  and  a zero  input  reference  will  flow 
through  the  other  path  during  phase  2 (<f>2).  At  phase  3 (<b3)  both  outputs  are  updated. 
Since  the  clock  phases  never  overlap,  the  cross-talk  between  signals  is  inexistent. 

Figure  3-6  helps  to  illustrate  the  signal  flow  at  a given  clock  phase.  According  to 
this  figure  and  Figure  3-5,  the  input  is  in(n)  = S(n ) during  phase  <J>j,  with  S(n)  the  sig- 
nal to  be  filtered,  and  conversely  in(n ) = 0 during  phase  <t>2.  At  phase  <J>3  the  output 
delay  elements  Dy,  and  D22  are  simultaneously  updated.  Consider  that  Ck=  ”on"  and  that 
the  phase  is  <t>2  ( in(n ) = 0).  According  to  Figure  3-5,  and  the  timing  diagram  of  Figure 
3-6,  the  output  of  D22  will  be  the  accumulated  offset  around  the  loop  called  Ref(n).  This 
reference  signal  may  now  be  memorized  externally  (offset  subtraction  block  in  Figure  3-5) 
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and  used  to  subtract  the  output  offset  from  the  input  signal  flow  path  for  offset  cancella- 
tion. 


/’’  \ 


Figure  3-5.  Offset  cancellation  concept 
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Figure  3-6.  Timing  diagram  to  illustrate  what  signal  is  present  in  each  delay  element  of 

Figure  3-5 


Tracking  the  right  offset  (e.g.,  there  is  no  guarantee  that  the  offset  in  both  the  signal 
and  reference  paths  are  equal)  still  remains  a problem.  To  guarantee  that  the  reference  sig- 
nal, Ref(n),  matches  the  signal  path  offset,  the  role  of  the  signal  and  the  offset  circuit  paths 
are  interchanged  in  each  half  period  of  clock  Ck  (Figure  3-5  and  Figure  3-6).  The  external 
memory  (offset  subtraction  block  in  Figure  3-5)  will  be  holding  the  correct  offset  needed 
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for  compensation  anticipating  in  this  manner  the  next  phase  offset  value  in  the  signal  path. 
It  should  be  noted  that  the  offset  is  subtracted  both  to  the  signal  and  offset  paths,  such  that 
the  reference  signal  is  only  the  open-loop  accumulated  offset  and  not  the  integrated  value 
given  by  Eq.  (3-4).  The  desired  clock  switching  necessary  to  interchange  the  paths  roles 
on  each  clock-cycle  can  easily  be  accomplished  with  simple  logic  gates  as  shown  in  Fig- 
ure 3-7. 


Figure  3-8  shows  a schematic  for  simulation  in  Hspice  [54].  The  feedback  (external 
loop)  was  implemented  with  the  help  of  a functional  current  source  with  an  added  offset  of 
4pA.  All  transistors  have  sizes  W/L  = 50p/12p  and  J = 50pA . The  model  in  all  sim- 
ulations is  1.2pm  Level  3 for  1.2pm  AMI — MOSIS  technology.  The  Hspice  CAPOP 
option  is  set  to  9 for  charge  conservation  calculations.  All  source  currents  are  transistors. 

Figure  3-9  and  Figure  3-10  show  the  simulation  outcome  for  two  different  p values 
(0.2  and  0.02  respectively).  In  Figure  3-9  part  (1),  no  cancellation  is  applied  and  the  output 
goes  up  to  -15  pA,  but  as  compensation  is  turned  “on”  (part  (2))  the  offset  quickly 


50 


approaches  1.1  (iA.  When  a square  pulse  is  applied  (part  (3))  the  system  integrates  the 
input  and  the  final  offset  remains  at  1.1  (J.A.  Hence,  there  is  no  interference  between  the 
offset  cancellation  and  the  signal  itself.  However,  it  is  required  that  the  input  to  be  sam- 
pled at  <f>j  with  a return  to  zero  sampling. 

Figure  3-10  presents  the  simulation  result  for  (1=0.02  showing  that  with  small  (J.  val- 
ues the  offset  can  be  extremely  high  (48  (iA).  But  as  soon  as  the  compensation  circuit  is 
activated  the  offset  drops  dramatically  to  -4(iA.  The  offset  compensation  still  exhibits 
dependence  over  the  |i  parameter,  but  much  less  than  without  compensation. 

The  simulation  results  show  that  the  technique  avoids  largely  the  offset  dependence 
on  the  feedback  parameter.  In  the  following  sections,  theoretical  support  will  be  presented 
to  help  understand  better  the  technique. 


ln(n) 


Figure  3-8.  Transistor  level  representation  of  Figure  3-5 
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Figure  3-9.  Simulation  results  (1=0.2.  1)  No  cancellation;  2)  Cancellation  turned  on;  3) 

Square  input  signal  of  20mA 


Figure  3-10.  Simulation  results  (1=0.02.  1)  No  cancellation;  2)  Cancellation  turned  on 
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3.4  Proof  of  Convergence 

Before  going  into  experimental  results  it  is  necessary  to  investigate  under  what  con- 
ditions the  offset  compensation  converges.  To  proceed  with  a proof,  a more  formal  repre- 
sentation of  the  method  is  required.  Such  a formal  representation  is  depicted  in  Figure  3- 
11. 


Figure  3-11.  Local  offset  compensation  formal  representation 


In  Figure  3-11,  the  common  feedback  block  1 - p.  of  Figure  3-5  is  broken  into  two 
equal  feedback  blocks  to  allow  the  update  of  the  input  signal  and  offset  reference  signal  at 
the  same  time.  The  separation  is  controlled  by  the  signals  and  <J>2  together  with  the 
associated  multipliers.  Given  that  <P2(n ) = ^(n-l)  and  assuming  4^(0)  = 8 (n), 
according  to  the  signal  representation  in  Figure  3-11,  the  input  signal  i(n)  will  flow 
through  path  1 when  n is  even  and  through  path  2 when  n is  odd.  Conversely  the  zero  ref- 
erence signal  will  be  flowing  through  the  same  paths  in  opposite  phases.  Since  the  feed- 
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back  1 - (X  is  crossed  at  the  output,  the  signal  and  reference  will  be  crossed.  Finally,  the 
output  multipliers  and  adders  represent  the  offset  subtraction  block.  Note  that  when  n is 
even,  the  input  to  the  delay  block  in  path  1 is  the  signal  but  its  delayed  output  is  the  refer- 
ence. This  reference  is  subtracted  to  the  output  of  path  2 which  represents  the  delayed  sig- 
nal to  be  scaled  and  added  to  i(n) . This  very  same  reference  is  also  subtracted  to  itself, 
scaled  and  added  to  the  zero  reference  signal  input  in  path  1 . The  loop  offsets,  Xof  1 and 
Xof2,  are  measured  according  to  Figure  3-2,  and  the  single  ended  filter  output  0{n)  is 
obtained  by  crossing  the  outputs  signals  0{(n),  and  02(n)  as  represented  in  Figure  3-12. 


*2 


Figure  3-12.  Crossing  signals  and  <f>2>  at  &c  outputs  of  Figure  3-11  to  obtain  the  filter 

signal  output 

Formal  representations  for  the  signals  3>j  and  <F2  can  be  formulated  as  Eq.  (3-5). 
This  description  of  Figure  3-11  matches  the  same  technique  described  for  Figure  3-5  but 
with  a more  suitable  representation  for  mathematical  manipulations 


<Fj (n)  = £ b[n -2-  k] 
k = o 

oo 

<D2(n)  = = £ b[n-(2  k+  1)] 


(3-5) 


k = o 
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The  outputs  Ox(n)  and  02{n)  in  Figure  3-11  can  then  be  formulated  as  follows 
(without  loss  of  generality  consider  in(n)  = 0): 


Ox(n)  = (1  — M-)  * {[1  — <E>2(«  — 1)]  • 02(n  - l)-3>1(n-l)-01(rc-l)}  + 

*o/! 

02(n ) = (1  - p.)  • {[1  —<£>,(«—  1)]  • Oj(n  - 1)  - d>2(n  - 1)  • 02(n  - 1)}  + 


(3-6) 


Considering  both  Eq.  (3-5)  and  Eq.  (3-6),  the  output  signals  can  be  reformulated  in  the 
form  of  Eq.  (3-7)  and  Eq.  (3-8). 


0,(n) 


Ao/l 

( 1 — M-)  * [02(n-  lJ-O^n-  1)]  + X 


0/1 


,n  even 
,n  odd 


(3-7) 


02(n) 


U\-\L)[Ox{n-\)-02{n-\)]+Xof2 

Uof2 


,n  even 
,n  odd 


(3-8) 


Before  analyzing  convergence  further,  lets  find  out  what  offset  in  Figure  3-11  would 
be  present  if  no  cancellation  procedure  were  applied.  Equivalently  if  the  signals  repre- 
sented by  <Fj  and  <f>2,  at  the  output  multipliers,  were  zero.  In  this  situation  Eq.  (3-6)  could 
be  written  as  Eq.  (3-9). 


0,(«)  = ( \-[L)-02(n-l)+Xofl 

(3-9) 

02(n)  = (I-iO-OjOi-D  + X^ 

To  find  the  offset  when  n — » °o  then  Ox(n)  = Oj(«  - 1 ) = X0jT[  and 
02(n)  = 02(n  - 1 ) = X0jT2 . Taking  this  equalities,  substituting  in  Eq.  (3-9)  and  solving 
the  system  of  equations  results  in  Eq.  (3-10). 


v. 


(3-10) 
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As  expected,  when  |i  ->  0 both  offsets  tend  to  infinity.  Figure  3-13  shows  the  simu- 
lation result  of  Figure  3-11  using  Matlab. 
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Figure  3-13.  Figure  3-11  simulation  result  without  offset  subtraction 
(M-  = 0.1,  X0f\  = 4,  Xaf2  = 7) 


The  two  signal  paths  alone  do  not  improve  offset.  The  final  (large  time)  offsets  mea- 
sured from  Matlab  simulation  were  X0jTl  = 54.21,  X0jT2  = 55.79,  which  matched  the 
values  predicted  by  Eq.  (3-10)  for  the  simulation  values  (Figure  3-13). 

Consider  now  the  offset  subtractor  activated  and  assume  initial  conditions 
Oj(o  - 1)  = X{  and  02(n  - 1)  = X2  ■ Iterating  equations  (3-7)  and  (3-8)  the  close  form 
can  be  proven  to  be  equations  (3-11)  and  (3-12)  (Appendix  B). 
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2-|i  of*  2-| j.  o/i 


1 t!:  . v + i . y 

2-n  2-(i  ^ 


(3-13) 


To  find  out  the  asymptotic  output,  the  limit  when  n — > °°  has  to  be  calculated.  Tak- 
ing into  consideration  that  the  summation  in  brackets  represent  the  summing  terms  of  a 
geometric  progression  with  ratio  r = — ( 1 — jj.)  and  that  the  stability  guarantees  always 
( 1 — (0.)  < 1 , then  the  limits  are  defined  by  Eq.  (3-13).  Considering  0 < |J.  < 1 and  assum- 
ing *0/1  < *0/2  *en: 
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n = even  — > • 


O ,00  = *o/i 


7 ' (Xof2  + Xofl)  J < XofT2  < Xo/2 


n = oJJ  — » • 


Xofl  < ^o/Tl  < 


(3-14) 


02(n)  - X0j2 


Equation  (3-13)  shows  that  the  offset  cancellation  scheme  converges  to  finite  val- 
ues. It  is  still  dependent  on  the  feedback  parameter  but  if  the  filter  is  low-pass,  the  limits  in 
Eq.  (3-14)  show  that  the  variation  over  the  parameter  is  negligible.  Actually  if  both  offsets 
match  there  is  no  dependence  over  the  feedback  parameter.  In  reality,  the  final  value  is 
upperbounded  by  the  biggest  accumulated  offset  measured  as  in  Figure  3-2.  It  is  either  that 
value  or  smaller.  If  however  1 < p < 2 , the  offset  will  be  increasing.  For  these  values  of  p 
the  filter  is  high-pass  and  it  is  unreasonable  to  use  the  offset  compensation  because  as  Eq. 
(3-4)  states,  the  offset  is  attenuated  if  p > 1 . We  may  conclude  that  the  offset  cancellation 
scheme  should  be  used  only  when  p < 1 . In  fact  this  is  the  most  frequent  occurrence  with 
signals  that  have  a 1// characteristic  and  for  which  the  gamma  filter  is  better  fitted  [31]. 

Figure  3-14  shows  a simulation  result  with  offset  subtraction.  As  predicted  from  ear- 
lier comments  and  equations,  the  offset  cancellation  method  tends  to  level-out  the  two 
path  offsets.  The  final  values  measured  with  Matlab  are  X0jji  = 5.421  and 
X0jT2  = 5.579  which  match  the  values  calculated  with  Eq.  (3-13). 

Figure  3-15  represents  the  same  simulation  but  with  nonzero  initial  conditions  and 
input.  The  result  equals  the  ideal  gamma  filter  shifted  by  the  same  offset  amount.  Equation 
(3-13)  is  plotted  in  Figure  3-16  for  different  values  of  p.  As  expected,  decreasing  p will 
attenuate  the  individual  open-loop  offsets,  Xof j and  Xof2,  but  will  also  make  the  final  off- 
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sets  close  to  each  other.  Nevertheless,  Figure  3-16  tells  that  if  the  open-loop  offsets  are 
unmatched,  the  output  signal  O(n)  will  be  affected  with  a summing  signal  that  results 
from  the  compensation  procedure.  Yet,  the  signal  is  a sinusoid  of  frequency  f/ 2 with 
magnitude  and  DC  values  that  can  be  calculated  from  Eq.  (3-13)  and  can  be  easily 
removed1.  For  the  same  example  of  Figure  3-14  and  taking  the  FFT  for  the  region  far  from 
the  transient,  Figure  3-17  is  obtained  where  the  magnitude  values  can  be  calculated  as  fol- 
lows: 

A • sin(2  x 71  xfd)  + DC 

• A = (Xofn-Xofn)/2  = 0.0789  (3-15) 

DC  = (Xofn  + Xofrl)/2  = 5.5 
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Figure  3-14.  Figure  3-11  simulation  result  with  offset  subtraction 
(M-  = 0.l,Xofl  = 4,  X0j2  = 7. 


1.  In  fact  this  signal  would  be  automatically  removed  with  the  smoothing  filter. 
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Figure  3-15.  The  same  as  Figure  3-14,  but  with  input  signal  and  initial  conditions 
Oj(n-l)  = 8 , 02(n  - 1 ) = -5.  Dashed  line  corresponds  to  an  ideal  gamma  filter  with 

the  output  added  with  a constant  equal  to  the  final  offset  of  O(n) 
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Figure  3-16.  Final  offsets  as  functions  of  feedback  parameter  |1.  (Xofl=10;  Xof2=-10) 


fd(f=^)  * 

Figure  3-17.  The  FFT  of  O(n)  in  Figure  3-14,  for  a region  far  from  the  initial  transitory 

response 
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3.5  Other  Nonideal  Effects  that  may  Affect  the  Proposed  SI  Offset  Cancellation  Method 
To  take  into  account  possible  gain  mismatches  in  a real  implementation,  gain  factors 
are  added  into  different  points  of  the  offset  model  as  illustrated  in  Figure  3-18. 


Figure  3-18.  Offset  cancellation  formal  representation  with  gain  errors  associated 


The  variables  A!  and  A2,  represent  the  gain  errors  associated  with  the  different 
delays  and  a represents  the  gain  error  associated  with  the  offset  subtraction  block  (Figure 
3-5).  With  the  added  terms,  equations  (3-7)  and  (3-8)  can  be  rewritten  as  Eq.  (3-16)  and 
Eq.  (3-17). 


rAj(l-n)(l-a)-02(n-l)  + Xo/1 
[A1(l-^[O2(n-l)-a01(/i--l)]+X 


Of 1 


O^n)  = 


,n  even 
,n  odd 


(3-16) 
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fA,(l  -U)  ■ [OAn- l)-a02(n-  1)]  +X  n ,n  even 

02(n)  = ' ^ (3-17) 

[a2(1  -h)(1  -a)  • 0,(«- l)+XoJ2  ,n  odd 

Comparing  these  equations  with  the  former  set  (equations  (3-7)  and  (3-8)),  the  main 
change  is  in  the  reference  signal  phase,  which  occurs  for  Oj(n)  when  n is  even,  and  for 
02(n ) when  n is  odd.  It  is  no  longer  the  accumulated  open-loop  offset.  The  effect  on  the 
reference  signal  as  n — > °°  can  be  calculated  realizing  that  during  the  reference  signal 
phase  Oj(n)  = 0{(n-  1)  = X 0yT1  and  02(n)  = 02(n-  1)  = X0yT2. 

Assume  at  this  point  that  the  offset  cancellation  is  connected  during  the  reference 
signal  phase  and  not  connected  during  the  signal  phase  for  < n < 0 . The  connection  for 
the  signal  phase  is  applied  at  n = 0 . In  this  case  the  new  reference  signal  is  stable  at 
n = 0 and  equations  (3-16)  and  (3-17)  can  be  written  as  equations  (3-18),  (3-19),  and  (3- 
20) 
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(3-18) 


(3-19) 


(3-20) 


1 - AjA2(1  - a)^(l  - p.)^  1 -AjA2(1  -a)  (1  -p.) 

The  worst  case  scenario  happens  when  |i  — > 0 . Taking  the  limit  of  (3-20)  results  in 


(3-21). 
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XofT\  ~ 
XofT2  = 


2 ’ Xofl  2 Xofl 

1 -AxA2(\  - a)2  1 - AjA2(1  - a) 

A,-(l-a)  i 

1 v ’ Y 4-  - . Y 

2 Ao/l  + 2 Ao/ 2 

l-AjA^l-a)  1 - AjA2(1  - a) 


(3-21) 


Forcing  a 20%  error  in  all  gains  (A,  = 1.2,  A2  = 0.8,  a = 0.8),  which  is  not 
unreasonable  in  a real  situation,  Eq.  (3-21)  evaluates  to: 


Vi  = Te  + 104X»/> 

(3-22) 

Xofn  = ~f'+l-04Xof2 


The  result  shows  that  even  with  relatively  imprecise  current  mirrors  the  increase  in 
the  reference  signal  from  the  ideal  Xofl  and  Xaj2  is  comparable  to  the  current  mirror 
imprecision.  In  this  case  the  biggest  increase  is  about  30%  in  both  XqjTI  and  XajT1  (con- 
sidering equal  open-loop  offsets),  which  is  not  significant  considering  that  we  are  at  the 
limit  case  where  |i  = 0 . In  reality  0 < p.  < 1 which  will  make  XofX  and  X0^  close  to  the 
ideal  values.  With  a careful  design  of  the  offset  subtraction  block  to  make  a close  to  one 
will  greatly  improve  the  performance.  Without  changing  any  of  the  previous  parameters 
except  increasing  a to  0.9  will  reduce  the  offset  to  about  a 15%  increase. 

It  should  be  noted  that  the  gain  imprecision  affects  the  loop  gain.  For  this  reason  the 
inequality  given  by  Eq.  (3-23)  has  to  be  always  guaranteed  otherwise  the  filter  goes  unsta- 
ble. 


A^O  -oc)2(l  ~n)2<  1 


(3-23) 
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The  proof  of  convergence  for  equations  (3-18)  and  (3-19)  can  be  found  in  appendix 
C.  The  proof  was  performed  using  the  approximation  for  the  reference  phase  defined  in 
Eq.  (3-24).  The  final  result  is  transcribed  in  Eq.  (3-25). 
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(3-25) 


As  already  mentioned,  the  offset  cancellation  is  effective  if  jx  < 1 . For  this  range  of 
values,  if  the  error  associated  with  a is  in  the  same  range  as  A j and  A2  and  if  Eq.  (3-26)  is 
true  (which  is  a condition  to  be  met  otherwise  the  filter  goes  unstable)  it  is  guaranteed  that 
the  constants  affecting  Xofl  and  Xof2  in  Eq.  (3-25)  are  less  than  one. 


(Aj(l  -p.)  < 1)  a (A2(l  — jll)  < 1 ) 


(3-26) 
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3.6  A Real  Chip  Test  for  the  SI  Integrator  Offset  Compensation 
To  test  the  offset  compensation  methodology,  a gamma  filter  with  programmable 
feedback  parameter  } x was  designed  with  1.2pm  AMI-MOSIS  technology.  The  complete 
schematic  of  the  designed  cell  is  shown  in  Figure  3-19. 

All  transistors  are  W/L  = 25.2pm/6pm  except  the  ones  at  the  current  mirror 
within  the  feedback  block  that  were  set  to  values  such  that  Pj  s 0.14  and  p2  = 0.57 . The 
parameter  is  selected  actuating  at  the  transistors  Pj  and  p2.  A switch  is  added  to  control 
externally  the  offset  compensation  connection  state  (offset  on/off  transistor).  The  bias  cur- 
rents were  set  to  50pA.  This  low  bias  current  is  intentionally  set  to  increase  the  offset  due 
to  clock  feedthrough  [55-57]  (if  needed,  an  introduction  to  CFT  can  be  found  in  Appendix 
A),  and  actually  verify  that  the  signal  independent  offset  is  cancelled. 


vdd 
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Figure  3-20  shows  the  measured  transient  result  for  the  two  implemented  gains.  In 
the  graph,  the  signal  and  reference  phase  updates  are  plotted  together.  The  circuit  was 
allowed  to  run  without  offset  compensation  for  some  time.  After  the  output  signal  settles, 
the  compensation  is  set  to  “on”.  This  moment  is  represented  by  the  vertical  line  in  Figure 
3-20.  As  expected,  the  reference  signal  is  set  to  the  final  offset  value  on  the  first  clock 
cycle,  while  the  signal  phase  needs  some  time  to  converge  to  a final  value.  This  was  pre- 
dicted by  the  theory  and  is  due  to  the  orthogonal  characteristics  of  the  reference  and  signal 
phases.  The  convergence  time  is  longer  for  smaller  values  of  (X,  which  is  coherent  with  the 
result  of  Eq.  (3-12),  and  after  some  time  the  offsets  tend  to  equalize.  This  is  well  repre- 
sented in  Figure  3-21,  where  both  steady  state  offsets  are  compared. 

The  results  clearly  show  different  offset  values  for  each  path  and  that  the  final  val- 
ues are  strongly  dependent  on  the  feedback  when  the  compensation  is  “off’.  Without  com- 
pensation, this  filter  topology  would  be  worthless  with  offsets  close  to  the  total  bias 
current.  However  with  compensation,  the  offset  in  the  different  paths  tend  to  equalize  and 
are  decreased  to  reasonable  values.  Table  3-1  shows  that  the  final  offset  values  are  slightly 
dependent  on  the  feedback  parameter,  but  not  as  much  as  without  compensation.  Finally,  it 
should  be  noted  that  the  output  transistors  are  not  in  the  loop,  which  means  that  the  mea- 
sures presented  so  far  are  a contribution  of  the  offset  from  this  cell  plus  the  offset  of  the 
overall  filter.  From  the  results,  it  can  then  be  concluded  that  the  compensation  technique  is 
feasible  and  that  the  theory  developed  is  a good  description  of  the  measurements. 

3.7  Harmonic  Distortion  and  Improvements 
Harmonic  distortion  is  another  effect  caused  by  the  gain  mismatches  discussed  in 
Section  3.5.  In  fact  if  the  gain  on  both  paths  is  not  equal,  the  input  signal  is  commuted 
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between  two  different  systems  at  every  other  sampling  time.  Figure  3-22  shows  two  plots 
demonstrating  the  resulting  harmonic  distortion. 

The  equivalent  gamma  filter  provides  the  same  response  as  Figure  3-22  but  misses 
the  second  line  around  0.44  xfs  thus,  this  line  represents  harmonic  distortion.  However  it 
gets  smaller  as  the  gain  mismatches  decrease.  If  the  gain  is  made  equal  on  both  paths,  the 
harmonic  distortion  completely  disappears. 


Table  3-1. Measured  steady  state  offset  maximum  values 


Feedback/ 

Compensation 

p.j  = 0.14 
(|IA) 

|i2  s 0.57 
(pA) 

‘off’ 

41.6 

28.8 

‘on’ 

7.6 

8.4 

Figure  3-20.  Measured  offset  cancellation  transient.  The  moment  where  the  compensation 
is  set  to  “on”  is  marked  by  a vertical  line  in  the  graph 


68 


SOI  21):  Signal  phase  <t>, 

DASHED:  Reference  sgnal  phase  <I>2 


40 
30 

4 20 
10 
0 

30 
20 
10 


— i 1 1 1 1 1 1 1 1— 


i 


h p-0.1 


Offset  cancellation . 
= ‘ofT 


T 


.Offset  cancellation 


|X — 0.5 


111  «| 

kk 


!,ul 


Hi 


time 

Figure  3-21.  Measured  steady  state  offsets  before  and  after  offset  compensation  connec- 
tion 


Figure  3-22.  Gamma  filter  response  with  offset  cancellation.  The  gains  are  affected  by  1% 

error 
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An  equivalent  procedure  to  Figure  3-5  can  be  employed  rendering  no  harmonic  dis- 
tortion due  to  gain  mismatch.  The  new  clocking  scheme  is  shown  in  Figure  3-23  and  the 
new  method  is  depicted  in  Figure  3-24. 

In  operational  terms,  the  new  offset  compensation  schematic  is  very  similar  to  Fig- 
ure 3-5,  but  needs  only  a single  path  for  the  signal  and  reference  phases.  The  delay  D2  is 
the  intermediate  memory  needed  to  keep  track  of  the  previous  signal  update.  The  clock 
scheme  of  Figure  3-23  guarantees  that  the  correct  delayed  signal  is  present  at  D3  when  the 
input  D1  is  updated.  Equations  (3-17)  and  (3-18)  are  perfectly  valid  for  the  present  situa- 
tion1 with  the  advantage  that  Aj  = A2  and  Xofl  ~ Xofl » then  no  harmonic  distortion  or 
offset  oscillation  results.  Another  advantage  is  that  it  uses  one  less  memory  cell  than  the 
previous  method.  Yet,  comparing  with  Figure  3-4  and  Figure  3-5,  the  clocking  scheme  is 
more  complex  and  imposes  lower  maximum  frequency  operation  due  to  the  extra  phases 
between  each  input  sampling  time  ^ 


Figure  3-23.  New  offset  compensation  clock  scheme. 


1 . Actually  all  the  techniques  and  results  found  in  the  previous  sections  are  directly  applied  to  the 
present  method 
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Figure  3-24.  Representation  of  the  new  offset  cancellation  concept 


3.8  Summary 

This  chapter  has  presented  a new  local  single-ended  offset  compensation  method 
using  SI  circuits,  to  reduce  the  offset  amplification  verified  with  gamma  kernels  when 
(i  < 1 . It  was  mathematically  shown  under  what  conditions  the  system  converges,  studies 
on  nonideal  effects  were  presented,  and  conclusions  drawn  concerning  the  minimization 
of  those  effects.  Experimental  measures  also  confirmed  theoretical  results. 


CHAPTER  4 

FILTER  AND  HOLD  (F&H) — A NOVEL  DISCRETE-TIME  FILTERING 

TECHNIQUE 

4.1  Introduction 

Switch-capacitor  and  switch-current  are  the  preferred  techniques  for  discrete-time 
processing.  The  former  can  accomplish  very  high  precision  time  constants  and  the  last  is 
suitable  for  standard  technologies.  Nevertheless,  for  big  systems  with  repeated  similar 
blocks,  neither  technique  is  area  efficient  and  the  power  cost  does  not  comply  with  the 
nano-power  requirements.  Low-area  and  nano-power  consumptions  are  usually  correlated. 
Simpler  circuits  take  less  elements  and  in  general  will  render  lower  power.  This  chapter 
presents  a novel  mixed  time  technique  that,  in  essence,  is  a continuous-time  system,  but 
uses  integration  switching  to  get  very  long  time  constants  with  little  area  and,  if  needed, 
low  power.  The  technique  was  denominated  “Filter  and  Hold  (F&H)”  [58]  and  this  chapter 
presents  a full  mathematical  framework  to  design  arbitrary  F&H  filters.  The  procedure  of 
using  switching  to  increase  a resistor  value  was  outlined  by  Lancaster  [59]  in  1975,  but  the 
author  of  this  dissertation  was  unware  of  its  existence  until  recently. 

The  novel  F&H  sampled  data  technique  bases  its  functional  principle  on  time  gating 
as  a multiplication  factor  to  scale  time  constants.  In  practice  the  effect  can  be  observed  as 
a capacitor  multiplication  because  in  a practical  active  filter  any  time  constant  is  associ- 
ated with  a capacitor.  The  multiplication  is  achieved  by  periodically  holding  the  capacitor 
voltage  (or  halting  the  integration  process)  after  a brief  period  of  charge  (discharge),  are 
therefore  achieved  with  F&H  designs.  There  are  various  instances  where  long-time  con- 
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stants  or  low  frequency  filters  are  needed.  Typically  for  60Hz  or  50Hz  cancellation,  bio- 
logical signal  conditioning  and  modeling,  or  audio  front-end  applications.  Typical 
continuous-time  Gm-C  VLSI  filters  have  lower  end  cut-off  frequencies  in  the  order  of 
magnitude  of  tens  of  kHz,  which  is  clearly  insufficient  for  those  applications  that  require 
frequency  ranges  in  the  order  of  tens  and  hundred  of  Hz.  The  F&H  technique  is  then  well 
fitted  for  the  design  of  the  olfactory  model. 

In  more  specific  terms,  the  F&H  technique  is  a mixed  analog/discrete-time  design 
that  combines  analog  continuous-time  conventional  filtering  with  sampling.  The  tech- 
nique proposed  here  is  based  on  the  very  intuitive  idea  of  permitting  a capacitor  to  inte- 
grate a current  during  T seconds  and  halting  it  during  a time  of  T- x seconds.  This  process 
is  repeated  every  T seconds.  The  resulting  time  constant  value  is  then  multiplied  by  the 
duty-cycle,  which  is  defined  as  the  ratio  of  T over  the  sampling  period  T.  The  multiplica- 
tive effect  to  the  time  constant  is  solely  based  on  the  duty-cycle  of  the  clock  signal  and  the 
sampling  period.  Therefore,  large  time  constants  can  be  achieved  without  a decrease  in 
sampling  frequency  or  with  high  capacitor  ratios  (or  transistors  in  SI  systems).  The 
switching  scheme  is  simple  and  both  the  area  and  power  requirements  can  be  made  small. 

4.2  F&H  Concept 

The  F&H  concept  can  be  easily  explained  for  1st  order  high-pass  (Figure  4-1)  and 
low-pass  filters  (Figure  4-5).  Consider  the  inputs  and  outputs  sampled  and  hold,  yielding 
the  discrete-time  F&H.  Although  the  F&H  is  a discrete-time  system  in  terms  of  input/out- 
put, in  reality  it  behaves  as  a hybrid  continuous-time/discrete-time  system. 
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Figure  4-1.  High-pass  F&H,  and  switching  clock 


Take  the  high-pass  F&H  example  of  Figure  4-1.  Current  is  allowed  to  flow  through 
the  capacitor  during  a brief  period  of  time  x.  For  the  rest  of  the  time  period,  T-  x , this  cur- 
rent is  zeroed.  Interrupting  the  current  suddenly  does  not  violate  physical  principles  since 
the  capacitor  voltage  is  an  integral  of  this  current,  hence  it  does  not  suffer  abrupt  changes. 

When  the  clock  turns  to  “on”  state  at  t = (n  - 1/2)  • T-  x , the  input  voltage  is 
already  fixed  to  a value  V,[(n  - 1)  ■ T] . If  the  capacitor  has  an  initial  voltage  different 
from  zero,  Vc  = Vt[(n-2)  • T]  - V0[(n-  l)-T],  then  the  difference  equation  of  the  sys- 
tem can  be  found  by  the  step  response  resulting  in  Eq.  (4-1).  The  respective  Z transform 
can  be  defined  by  (4-2)  where  k = x/T  represents  the  duty-cycle  of  d>t. 

V0{nT)  = (V0[(n-l)r]  + {Vi[(n-l)71-yi[(n-2)r]})-e_T/(/?C)  (4-1) 


^o(z)  _ -x /(RC)  l-Z  1 -1 

V{z)  ~ 6 ‘ m -l  • z 

<=> 

Vo(z)  _ -kT/ (RC)  1 - Z~l  -1 

Vt(z)  ~ 6 


(4-2) 
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The  filter  represented  by  Eq.  (4-2)  is  indeed  an  high-pass  filter  with  a zero  at 
z = 1 , and  a pole  at  z = e~kT/{RC) . Depending  on  the  value  of  k,  this  pole  can  be  made 
close  to  z = 1 , without  changing  the  time  period  T nor  C.  However,  keeping  k constant, 
changing  T does  not  change  the  pole  position  relative  to  the  signal  bandwidth.  The  sam- 
pling period  changes  both  input  sampling  and  the  system  bandwidths.  The  relative 
decrease  or  increase  of  pole  position  is  followed  by  the  same  amount  of  relative  input 
bandwidth  compression  or  expansion  in  terms  of  the  normalized  frequency 
| W|  = |r-Q|<7t.  This  is  not  the  case  for  a SI  or  SC  circuits.  The  pole  and  zero  positions 
depend  only  on  transistor  and  capacitor  ratios,  respectively.  Consequently  a different  sam- 
pling frequency  will  change  only  the  relative  signal  bandwidth  in  the  normalized  fre- 
quency spectrum  but  the  filter  pole  and  zero  positions  are  kept  unchanged.  Thus,  in 
opposition  to  the  F&H  case,  changing  the  sampling  period  in  an  SC  filter  affects  the  fil- 
tered signal.  Varying  the  sampling  period  affects  the  signal  time  resolution.  The  same  hap- 
pens with  F&H  but  in  this  case  the  filtering  characteristic  is  kept  unchanged.  To  better 
illustrate  the  above  explanation,  a simulation  was  performed  over  the  SC  low-pass  gamma 
filter  shown  in  Figure  A-4  (Appendix  A).  Two  different  sampling  frequencies  were  used. 
The  simulation  result  is  shown  in  Figure  4-2.  It  is  clear  that  for  the  same  p value,  defined 
by  the  capacitor  ratio  in  Eq.  (A-9)  (Appendix  A),  the  behavior  depends  on  the  sampling 
period  (the  input  is  kept  unchanged). 

Figure  4-3  shows  a simulation  result  for  the  F&H  in  Figure  4-1  together  with  the 
continuous-time  prototype  response.  The  resistor  and  capacitor  were  set  to  R = 10&Q 
and  C = InF  respectively  and  the  duty-cycle  is  k=10%.  The  capacitor  for  the  continu- 
ous-time prototype  is  set  to  C = 10 nF . As  expected,  the  response  of  the  F&H  is  the  same 
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as  the  RC  continuous-time  filter  except  that  the  output  is  sampled.  In  Figure  4-4  a zoom  in 
of  a squared  area  is  shown  for  better  understanding.  With  the  same  duty-cycle,  the  simula- 
tion shows  that  the  filter  behavior  is  not  affected  by  the  sampling  period,  only  the  time  res- 
olution changes.  Another  interesting  aspect,  and  the  actual  main  useful  practical  feature,  is 
parameter  scaling.  As  mentioned  earlier,  the  time  constant  is  scaled  by  k.  Given  that  k is 
less  than  one,  a k - C smaller  capacitor  can  be  used  to  achieve  an  equivalent  % - R • C 
time  constant.  Theoretically  the  capacitor  can  be  made  as  small  as  desired,  however  it  is 
not  difficult  to  attain  realizable  physical  limitations. 


Figure  4-2.  SC  gamma  filter  with  p = 0.2 . a)  Input;  b)  Output  with  T = 5(1$ ; c)  Output 

with  T = 50  (is 


Figure  4-3.  Two  high-pass  F&H  results  (duty-cycle  k=10%  in  all)  over  the  same  input  sig- 
nal. a)  Input;  b)  Output  of  Figure  4-1  with  the  switch  always  on  (continuous-time  equiva- 
lent) but  with  capacitor  10  times  bigger;  c)  Output  with  T = 5p$ ; d)  Output  with 

T = 50p$ 
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Figure  4-4.  Zoom  over  Figure  4-3  first  200jxs  (the  indexes  represent  the  same  as  the  ones 

in  Figure  4-3) 


The  same  procedure  can  be  applied  to  a low-pass  filter  configuration.  As  with  the 
high-pass  filter,  a switch  is  strategically  inserted  to  periodically  switch  the  current  flowing 
through  the  capacitor  as  shown  in  Figure  4-5 

Applying  to  this  case  the  same  method  used  to  find  the  high-pass  F&H  result,  the 
low-pass  F&H  transfer  function  can  be  found  to  be  Eq.  (4-3),  and  the  same  facets  dis- 
cussed earlier  for  the  high-pass  F&H  apply  here. 

w i-.-*r/(*C)  . t .... 
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Figure  4-5.  Low-pass  F&H 
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Figure  4-6.  Two  low-pass  F&H  results  (duty-cycle  k=10%  in  all)  over  the  same  input  sig- 
nal. a)  Input;  b)  Output  with  T = 5^5 ; c)  Output  with  T = 50p,s ; d)  Output  of  Figure  4- 
1 with  the  switch  always  on  (continuous-time  equivalent)  but  with  capacitor  10  times  big- 
ger 

Band-pass  and  band-reject  filters  can  be  assembled  from  the  F&H  high-pass  and 
low-pass  sections.  In  this  perspective,  the  first  order  F&H  is  general  and  can  be  applied  for 
the  four  known  frequency  filtering  characteristics.  However,  can  other  filter  topologies  be 
implemented  with  a F&H  configuration?  In  what  conditions  can  the  technique  be  applied? 
In  summary  how  general  is  the  F&H  technique?  This  is  an  important  question  that  needs 
to  be  addressed  in  order  to  attest  the  importance  and  generality  of  the  technique  and  will 
be  the  theme  of  the  following  sections. 

4.3  Generality  of  the  F&H  Discrete-Time  Filter 
To  prove  the  F&H  generality,  two  systems  will  be  considered.  The  systems  are  sim- 
ilar with  a difference,  one  has  the  dynamic  matrices  scaled  while  the  other  has  the  states 
halted  periodically  by  a clock  signal  displaying  a duty-cycle:  k - x/T.  The  input  signal 
is  sampled  on  a different  phase  (as  done  with  the  first  order  sections  in  Figure  4-1  and  Fig- 
ure 4-5).  This  sampled  and  hold  signal  is  applied  to  both  systems,  and  if  they  exhibit  the 
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same  output  for  every  n ■ T seconds  with  n£  S,  then  from  an  input/output  perspective 
the  systems  are  equivalent.  For  simplicity  the  initial  conditions  are  considered  to  be  zero. 
Figure  4-7  illustrates  graphically  what  is  the  expected  output  behavior  for  the  two  systems 
(continuous-time  versus  F&H). 

High-Pass  Low-Pass 


T . T 


Figure  4-7.  Graphical  representation  of  a generic  F&H  response  (solid)  compared  with  the 
continuous-time  filter  (dashed)  with  RC/k  slower  time  constant  over  the  same  sample  and 

hold  input 

Consider  an  input  signal  defined  as  Eq.  (4-4),  where  • denotes  convolution  oper- 
ation and  rect{.)  is  the  pulse  function  defined  in  Eq.  (4-5).  For  better  understanding,  Figure 
4-8  shows  a graphical  representation  of  these  mathematical  operations. 
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Consider  now  a generic  realization  of  a linear  system  described  by  a set  of  state 
space  equations  (4-6)  [60].  Equation  (4-6)  already  explicitly  portrays  the  sampled  and 
hold  input  signal  us(t)  defined  in  Figure  4-8. 


uJt)  = u{t ) 


£ S(t-kT) 

v*  = 0 


• recti 


c- 


-772' 


<=> 


us(t)  = 


= 0 
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f 

- T/2\ 

• recti 

j 

T ) 

-772  <t<T/2 
OW 


(4-4) 


(4-5) 


fx:9l-»9t" 

1 y:9T->9l 

|jc(0  = A ■ x(t)  + B ■ us(t) 

Before  going  any  further  it  is  important  to  give  some  physical  meaning  to  Eq.  (4-6). 
The  F&H  presented  in  last  section,  relied  on  switching  the  current  that  charges  (or  dis- 
charges) a capacitor.  The  same  method  has  to  be  applied  to  Eq.  (4-6).  In  an  active  filter  the 
state  variables  are  invariably  associated  with  a capacitor  voltage.  The  capacitor  voltage  is 
defined  as  dv{t)/dt  = v(r)  = 1/C  • i(t) , where  C and  i(r)  are  the  capacitor  value  and 
current,  respectively.  If  the  only  dynamic  element  in  the  physical  system  defined  by  Eq. 
(4-6)  is  a capacitor,  then  accordingly  x(t)  represents  a vector  voltage  derivative  and  the 
right  hand  side  of  Eq.  (4-6)  represents  a current  vector  flowing  through  the  capacitors.  In 
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order  to  make  Eq.  (4-6)  a F&H  representation,  the  integration  just  needs  to  be  halted  every 

T seconds  for  a time  duration  of  x - T seconds. 

In  a linear  system,  a generic  representation  for  any  instant  of  time  referred  to  any 

AT 

other  initial  state  instant  at  time  tQ,  can  be  stated  as  Eq.  (4-7)  where  e is  a state-transi- 
tion matrix  [61],  evaluated  for  t = T. 

If  the  system  starts  at  rest  (i.e.,  x(r0  = 0“  ) = 0),  integrating  for  the  first  x seconds 
results  in  Eq.  (4-8).  Remember  Figure  4-8  where  during  T seconds: 

Vn  e R,  re  ( nT , ( n + l)T]:us(t)  = un. 

t 

x (r)  = eA'0~‘o) -x(t0)+ \(eA(,~a) -B-us(a))da 

‘0  (4-7) 

y(t)  = C ■ x(t)  + D • us(t ) 


' 

\ 

x(x)  = ua  ■ 

J(/  (,-°y<x 

ko 

7 

(4-8) 


y(x)  = C • x(x)  +D  ■ u0 

DO  = {re  SR:x<r<r} 

(x(r)=  *(x)),(y(r)=  y(x))  VreDO 

This  result  is  the  initial  condition  for  the  next  integration  period  that  starts  at  t = T+  and 
halts  again  at  r = T + x . Remember  that  from  Eq.  (4-8)  Jt(f)|f  = T = x(z) , so  reiterating 
Eq.  (4-7)  results  in  Eq.  (4-9).  Making  the  change  of  variable  (3  = a-T  on  the  second 
integral  reduces  Eq.  (4-9)  to  Eq.  (4-10).  Iterating  repetitively  it  can  be  easily  proven 
(Appendix  D)  that  the  state  and  output  of  the  system  is  represented  by  Eq.  (4-11). 
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y(T+x)  = C-x(T  + t)  + D ■ ux 


x(T  + T) 


(/  T • Uq  + Mj) 


(x  ^ 

j(/(T-pVp 

Vo 


B 


y(T  + t)  = C • jt(r+  t)  + D • «j 

D1  = {re  SR:T+T<r<2r) 

WO  = jc(r+  x)),  CKO  = y(T+x))  v/ e di 


(4-10) 
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x((n-l)r+T)  = £V(/-Tr1~'- 
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Vne  S 


*(0+)=  0 n = 0 (4’n) 

y((n-l)T  + x)  = Cx((n-1)T+X)  + Dun 

Dn  = {t 6 SK:(n-l)r+T<r<n7\  Vn  e X } 

(jc(0  = x((n-l)r+T)),(y(0  = y((«-l)r+x))  VteDn,  Vne  X 

The  domain  Dn  results  from  the  union  of  the  sets  defined  as 
Df  = (re  9l:(i- l)r+T</<iT}  for  i = 1,2,  ...n,  which  are  disjoint  and  conse- 
quently Eq.  (4-11)  does  not  define  x(t)  for  all  time.  Although  it  is  easy  to  frame  x(t)  for 
any  instant  of  time  it  is  genuinely  not  needed  because  the  F&H  output  results  from  sam- 
pling x(t)  precisely  at  t = nT  which  is  in  the  domain  Dn.  Hence,  sampling  this  equation 
every  t = nT , results  in  the  output  discrete-time  signal  defined  by  Eq.  (4-12). 

n- 1 ( x \ 


y(n)  = C-  £V( 


Ax  .n-l-i 
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Vo  ' 
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Now  consider  a second  system  represented  by  Eq.  (4-13).  The  system  is  very  similar 
to  Eq.  (4-6).  Actually  the  only  difference  is  that  the  feedback  matrix  A and  the  input  vector 
B are  scaled  by  k (for  example  by  simply  making  the  capacitor  value  to  change  by  1/k, 
(k  < 1 ).  In  physical  terms  the  current  into  the  capacitor  is  k times  smaller  than  in  Eq.  (4-6) 
Functionally  this  system  is  allowed  to  integrate  during  the  full  sampling  and  hold  period  T. 

fZ:SR->SR" 

U:sr"->sr 

Jz(0  = k-  A-  z(t ) + k ■ B ■ us(t) 

|o(r)  = C ■ z(t)  + D ■ us(t) 

Applying  the  very  same  procedure  utilized  to  find  Eq.  (4-11)  at  any  instant  of  time 
t = nT,  the  response  of  this  new  system  will  be  given  by  Eq.  (4-14).  Making  the  change 
of  variable  P = (x/T)  • a results  into  Eq.  (4-15). 
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n = 0 


If  now  k is  forced  to  be  k = x/T  then  Eq.  (4-15)  is  finally  reduced  to  Eq.  (4-16), 


and  the  discrete-time  output  signal  can  in  turn  be  defined  by  Eq.  (4-17). 
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Comparing  equations  (4-16)  and  (4-17)  with  equations  (4-11)  and  (4-12)  respec- 
tively, it  is  possible  to  conclude  that  when  k = x/T , Eq.  (4-18)  is  verified. 

Equation  (4-18)  states  that  the  outputs  of  both  systems  are  indistinguishable  if  sam- 
pled every  t = nT.  Thus,  F&H  filters  are  general.  Given  k < 1 , it  should  be  noted  how- 
ever, that  the  F&H  defined  by  Eq.  (4-11)  would  be  utilizing  k times  smaller  capacitors. 
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1 = 0 Vo  / 

[z(nT)  = x(nT)]  =>  [o(n)  = y(/i)]  (4-18) 

Finally  the  difference  equation  that  characterizes  the  F&H  and  the  correspondent 
system  Z transform  is  represented  by  Eq.  (4-19)  and  Eq.  (4-20)  respectively  (see  Appen- 
dix E)  and  represents  a step  invariant  filter  [62], 

x(n)  = eAkT -x[(n-  1)]  +un_1  ■ [eAkT - 1]  - A-1  • B,k  = %/T  (4-19) 

Y(z)/U(z)  = (C-  [/ — z_1  • eAkT]1  • z_1  • [eAkT-I]  A~l  ■ B + D);k  = x/T  (4-20) 

Previous  qualitative  and  mathematical  results  have  shown  that  the  discrete-time 
F&H  is  a general  procedure  that  can  be  applied  to  filters  of  any  order.  The  filter  may  be 
low-pass,  high-pass,  band-pass  or  band-reject.  In  formal  terms,  a general  F&H  for  a stair- 
case discrete-time  input  followed  by  an  ideal  smoothing  filter  at  the  sampled  output,  can 
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be  stated  as  in  Eq.  (4-21).  It  should  be  noted  however,  that  the  physical  system  has  a feed- 


back matrix  A and  input  vector  B.  The  scaling  term  k (k  = x/T)  arises  from  the  current 
switching  method 


One  might  ask  if  any  active  filter  implementation  can  be  configured  into  a F&H  sys- 
tem. There  is  no  direct  answer  to  this  question.  Some  implementations  will  easily  yield  the 
F&H  configuration,  in  others  not  so  easily.  The  general  rule  is  to  start  with  a known  phys- 
ical active  filter  implementation  and  place  switches  strategically  throughout  the  filter  such 
that  the  current  through  the  capacitors  are  periodically  interrupted.  However,  for  Eq.  (4- 
11)  and  Eq.  (4-16)  to  be  equal,  the  output  y(t)  has  to  be  defined  at  the  sampling  times  nT . 
In  this  sense  the  capacitor  voltage  (the  state)  has  to  be  available  at  the  output  structure  at 
all  times  in  order  to  guarantee  the  correct  sampling.  This  indicates  that  some  active  filter 
configurations  might  not  meet  these  requirements. 

Another  interesting  feature  with  the  F&H  is  that  no  aliasing  is  introduced  in  the 
resulting  system  as  Eq.  (4-21)  shows.  The  aliasing  would  occur  due  to  the  input  sampling. 
However  the  input  signal  is  assumed  band-limited  hence  no  distortion  results  due  to  alias- 
ing. 


Consider  the  general  vector  filter  representation  in  Figure  4-9,  and  the  low-pass 
KRC  and  multiple-feedback  band-pass  filters  examples  in  Figure  4-10  [63].  Following 
previous  discussion,  switches  were  placed  strategically  to  control  the  current.  The  sample 


(4-21) 
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4.4  Some  Active  Filters  Simulation 
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and  holds  are  added  to  sample  the  input  (assumed  band-limited)  to  generate  us(t)  (Figure 
4-8)  and  to  synchronize  the  output  to  the  input  sampling  clock. 

In  order  to  achieve  a stable  input,  the  F&H  system  and  the  sample  and  hold  block 
are  switched  at  different  clock  phases.  The  same  is  valid  for  the  output  (i.e.,  the  output  is 
sampled  at  a time  instant  where  the  F&H  output  is  stable).  Table  4-1  summarizes  the 
parameter  set  used  to  simulate  the  vector  filter.  In  addition,  Table  4-2  summarizes  the 
parameter  set  for  the  KRC  and  multi-feedback  filters.  The  continuous-time  prototype  uses 
l/k  = 100  bigger  capacitors  than  the  F&H. 

Figure  4-11  to  Figure  4-13  plot  the  simulation  results  of  the  different  filter  configu- 
rations depicted  in  Figure  4-9  and  Figure  4-10.  The  sampling  frequency  is  set  to  20kHz  in 
all  F&H.  Each  plot  shows  the  result  for  the  F&H  and  the  sampled  and  nonsampled  outputs 
of  the  continuous-time  filter.  The  input  signal  utilized  for  test  is  either  a 250Hz  square 
wave  or  the  sinusoidal  sum  represented  by  Eq.  (4-22). 

u(t)  = sin(27t2007  + 0.0567t)  + 1.5  sin  (27t3307  + 0.18571)  + (4  22) 

+ 0.8  sin  ( 27120507  + 0.23471)  + 1.3  sin  (271425  7 + 0.11971) 

As  expected,  both  F&H  and  sampled  continuous-time  system  outputs  coincide.  It 
can  also  be  verified,  in  zoomed  areas,  that  the  non-sampled  continuous-time  output  passes 
through  the  points  defined  at  7 = nT  with  the  same  magnitude  as  the  F&H.  This  is  con- 
formal with  earlier  theoretical  developments. 
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Figure  4-10.  KRC  low-pass  (vLP)  and  multiple-feedback  band-pass  (vBP)  filters 
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Table  4-1.  Vector  filter  parameters 


Continuous-Time 
Vector  Filter 

F&H  Vector 
Filter 

R1 

10k£2 

10k£2 

R2 

10k£2 

lOkQ 

R3 

86k£2 

86ki2 

R4 

10k£2 

lOkQ 

c 

15nF 

0.15nF 

k = x/T 

- 

1% 

fo  = 1/(2  nR2C) 

1061Hz 

<=>  1061  Hz 

«-K‘*8  ’ 

3.2 

3.2 

Table  4-2.  KRC  and  multiple-feedback  band-pass  (BP)  filter  parameters 


Continuous-Time 
KRC  Filter 
(Low-Pass) 

F&H  KRC 

Filter 

(Low-pass) 

Continuous-Time 
BP  filter 
(High-Pass) 

F&H  BP 
Filter  (High- 
pass) 

R1 

10k£2 

lOkQ 

10k£2 

lOkQ 

R2 

10k£2 

10k£2 

100k£2 

lOOkQ 

R3 

lOkQ 

lOkQ 

- 

- 

R4 

250k£2 

250k£2 

- 

- 

Cl 

3.8nF 

0.038nF 

6nF 

0.06nF 

C2 

3.8nF 

0.038nF 

6nF 

0.06nF 

k = x/T 

- 

1% 

- 

1% 

fo 

l/^lnQRjC^ 
= 834 Hz 

<=>  834 Hz 

1/(2ji^^C,) 
= 839 Hz 

<=>  839 H 

Q 

Jr*/r3  = s 

5 

(Jr2/Rx)/2  = 1.6 

1.6 
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Figure  4-11.  Vector  filter  response  to  a square  input  (continuous-time  and  F&H,  see  text 

for  details) 


•!«l*  ••1*2  MIM  mw* 


Time  (s) 


Time  (s) 


Figure  4-12.  Vector  filter  response  to  a sum  of  sinusoids  (Continuous-time  + F&H,  see 

text  for  details) 
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Time  (s) 

Figure  4-13.  Simulation  result  for  KRC  and  multiple-feedback  band-pass  filter  of  Figure 
4-10  (the  curves  labeling  is  the  same  of  Figure  4-12,  and  see  text  for  details) 


To  test  the  generic  discrete -time  F&H  representation  defined  by  equations  (4-19) 
and  (4-20),  a simulation  was  performed  with  Matlab  using  the  vector  filter  in  Figure  4-9. 
The  state  space  representation  of  the  vector  filter  continuous-time  prototype  is  defined  by 


-a  b 
-c  0 


, the  transition 


Eq.  (4-23).  Making  the  feedback  matrix  A referenced  as  A = 
matrix  will  be  given  by  Eq.  (4-24)  (with  Y = kT  for  Eq.  (4-20)). 

Figure  4-14  shows  clearly  that  the  F&H  Hspice  and  the  DSP  Matlab  simulation 
coincide,  attesting  the  full  dynamic  characterization  of  the  discrete-time  F&H. 
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Figure  4-14.  Discrete  F&H  vector  filter  response  to  a square  input,  versus  MATLAB  sim- 
ulation of  Eq.  (4-19)  for  the  same  input 


4.5  Continuous-Time  F&H 

The  F&H  with  sample  and  hold  inputs  is,  in  signal  processing  terms,  an  implemen- 
tation of  a step  invariant  filter  [62].  However,  experiments  have  shown  that  the  technique 
is  more  complex  and  powerful.  Let  u(t)  be  a generic  continuous-time  signal  and  band  lim- 
ited according  to  the  Nyquist  sampling  criterion.  This  signal  is  then  applied  to  the  F&H 
input  without  any  previous  sampling.  Experiments  show  that  the  ideally  smoothed  F&H 
output  coincides  with  the  signal  coming  from  the  equivalent  continuous-time  filter  but, 
with  scaled  dynamics.  If  this  holds  for  all  band  limited  signals,  then  the  S/H  can  be 
avoided.  Nevertheless,  a proof  of  generality  is  needed  but,  it  is  yet  to  be  achieved. 

Equation  (4-25)  represents  a generic  continuous-time  system.  The  F&H  counterpart 
is  represented  in  Eq.  (4-26)  where  s(t)  is  the  switching  signal  defined  by  equations  (4-4) 


and  (4-5). 
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Figure  4-15  shows  an  Hspice  simulation  result  for  the  vector  filter  defined  by  Eq.  (4- 
23)  (with  parameter  values  listed  in  Table  4-1).  The  F&H  output  follows  closely  the  con- 
tinuous-time output  signal.  A Matlab  Runge-Kutta  simulation  of  Eq.  (4-26)  is  also  plotted 
in  Figure  4-15.  As  expected,  both  Hspice  and  Matlab  simulation  results  coincide,  reinforc- 
ing the  argument  that  Eq.  (4-26)  defines  the  physical  F&H  system. 


Jx(t)  = A ■ x(t)  + B ■ u(t) 
|y(r)  = C ■ x(t)  + D • u(t) 


(4-25) 


jx(0  = A • x(t)  ■ s(t ) + B ■ u{t)  • s(t) 
ly(0  = Cx(t)  + Du(t) 


*■ 


Time  (ms) 


Time  (ms) 


Figure  4-15.  F&H  vector  filter  response  to  a continuous-time  signal  found  using  Hspice 

and  Matlab  simulation 
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4.6  Noise  in  the  F&H  Filter 

Without  the  mathematical  framework  necessary  to  analyze  generic  F&H  systems 
with  analog  input  signals,  it  is  very  difficult  to  analyze  the  noise  performance.  However  it 
is  possible  to  get  some  insights  from  first  order  analysis.  In  fact  the  first  order  F&H  with  a 
continuous-time  input  (Figure  4- 16a)  is  a sample  and  hold  circuit  but,  not  restricted  to 
RC« T . In  fact  it  is  exactly  the  opposite,  the  F&H  relies  in  disregarding  such  a constraint 
to  act  as  a mixed  discrete-time  filter.  Nonetheless,  the  noise  analysis  for  sample  and  holds 
[64]  can  still  be  extended  for  the  first  order  F&H  sections. 

Consider  then  the  low-pass  F&H  filter,  and  instead  of  a signal  V}(r)  take  a voltage 
source  n(t)  representing  the  total  equivalent  input  noise.  Noise  in  the  present  context  is  an 
uncorrelated  stochastic  signal  with  unlimited  bandwidth  and  flat  magnitude  spectrum  (i.e., 
the  noise  is  white)  and  is  mainly  generated  by  the  resistor.  The  spectral  density  is  well 
known  and  given  by  Eq.  (4-27)  [64]. 

n(t)2  = 4 KTR  ( V/Hz ) (4-27) 

Assume  that  the  filter  is  operating  for  a long  time,  long  enough  that  it  can  consid- 
ered working  since  t = with  the  time  reference  chosen  to  be  some  place  very  far  from 
the  transient.  Consider  the  low-pass  and  high-pass  filter  configurations  shown  in  Figure  4- 
16.  Let  X(jw)  be  the  Fourier  transform  operation  over  x(t).  Finally,  F(s)  represents  an  ideal 
smoothing  filter  with  formal  representation  given  by  Eq.  (4-28). 
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vi(‘)  A * , A vop4h(d  nrr 

— Wr~*\x) — — f(«) 

R 1 


VoLp(‘) 

— ► 


a) 

Figure  4-16.  Continuous-time  F&H  (F(s)  is  an  ideal  smoothing  filter  and  s(t)  is  a current 

signal),  a)  Low-pass;  b)  High-pass 


FO'w) 


|w|  < n/T 
|w|  > (n/T) 


(4-28) 


The  current  in  the  capacitor  can  be  defined  as  s(t)  ■ i(t),  where  i(t)  represents  the 
current  that  flows  when  the  switch  is  “on”  and  defined  by:  i(t)  = (v,(r)  - voF&H(t))/R- 
Then,  the  voltage  at  the  output  ( voF&H(t ))  is  given  by  Eq.  (4-29),  and  the  Fourier  represen- 
tation defined  by  Eq.  (4-30).  The  S(jw)  signal  is  a periodic  pulse  train  with  period 
w0  = 2n/T  with  a sitic(.)  envelope  and  defined  by  Eq.  (4-31). 


vof&w( 0 = W(RC)-  J{s(0-(v,(0-voF&H(0)}*  (4-29) 

— oo 

VMH V»)  = 4 • Ww)  • (V,(jw)-VoFSiH(jw)));  (4-30) 
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S(jw)  = x- 


(4-31) 


■ &(jw  - mw0) 


Finally,  Eq.  (4-30)  can  be  rewritten  for  the  noise  source  as  shown  in  Eq.  (4-32). 
N(jw)  is  the  Fourier  transform  of  n(t)  and  represents  the  total  input  noise.  It  further  can  be 
rearranged  in  form  of  Eq.  (4-33).  Since  the  noise  is  not  band  limited,  the  replicas  in  the 
summation  term  will  foldover  the  base-band  |w|  < w0/2 . As  expected,  the  left  hand  side 
of  Eq.  (4-33)  also  shows  that  the  F&H  output  is  replicated  every  mw0  but  modulated  by 
the  F&H  low-pass  transfer  function  for  m * 0 . However,  if  w0»a  • k the  summation 
term  will  be  strongly  attenuated  by  the  filter  envelope  and  can  be  neglected.  Thus,  after  an 
ideal  smoothing  filter  is  applied  to  the  output  (multiplying  F(jw ) on  both  sides  of  Eq.  (4- 
33)),  the  base-band  of  the  resulting  signal  is  approximately  a filtered  aliased  noise  repre- 
sented by  Eq.  (4-34). 


■VoF&HVw~jmwo)  + 


VoF&h(Jw)  - 


(4-32) 


• N(jw  - jmw0 ) 
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ak  + jw 


(mw»  • $ 
sm(mtv0  ■ |) 


VoF&h(Jw -Jmw  0) 


(4-33) 


Vm  = — V"!VV0  • r 


N(/'w  -jmw0) 


v°"Uw)sd?h*'"Uw)  <4_34) 

Assume  now  an  equivalent  noise  bandwidth,  BW,  constrained  to  w0«£W<2/t 
(the  noise  after  the  sinc(.)  first  zero  is  attenuated).  To  simplify  further  the  analysis  consider 
that  (2/t)»w0  (which  is  true  for  small  duty-cycles)  such  that  for  w < (2 BW  + w0/2) , 
sinc(mw0|)  = 1 as  Figure  4-17  shows.  These  conditions  will  maximize  the  aliased  noise 
over  the  base-band  frequency  |w|  < w0/2 . Therefore,  the  white  noise  that  folds  over  the 
base-band  will  increase  in  magnitude  as  much  as  the  equivalent  bandwidth  decrease  (Fig- 
ure 4-18).  This  is  the  signal  N(jw)  in  Eq.  (4-34)  that  results  after  the  ideal  smoothing  fil- 
ter. Consequently  the  noise  increases  in  base-band  due  to  undersampling  but,  is  also 
reshaped  by  the  equivalent  F&H  filter.  Similar  result  is  obtained  with  the  first  order  high- 
pass  F&H. 

Similar  effects  occur  with  sampled  systems  other  than  F&H.  However,  since  F&H 
bent  more  for  low  frequency  poles  applications,  the  equivalent  resistors  will  possibly  be 
larger.  Therefore,  in  general  a F&H  system  will  render  a higher  base-band  noise  spectral 
density  than  systems  that  do  not  rely  on  large  resistor  values  to  accomplish  the  time  con- 


stant. 
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Figure  4-18.  Input  and  sampled  noise  spectral  densities  in  the  frequency  domain 


The  F&H  is  a sampled  data  system  and  consequently  it  is  also  sensitive  to  clock 
feedthrough.  Harmonic  distortion  and  offsets  resulting  from  CFT  will  influence  the  filter 
performance.  For  low-frequency  applications  however,  the  capacitors  used  in  the  F&H 
system  should  be  reasonably  high  thus  reducing  the  charge  error. 
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4.7  F&H  VLSI  Implementation  of  KO  Dynamics 
The  F&H  circuit  designed  for  the  KO  dynamics  is  shown  in  Figure  4-19.  The  circuit 
is  a cascade  of  two  first  order  low-pass  filters.  Each  low-pass  section  is  updated  in  differ- 
ent phase  clocks  allowing  to  internally  integrate  a delay  block  necessary  to  uncouple 
instant  feedback  when  this  block  is  applied  to  built  the  silicon  olfactory  model. 


Figure  4-19.  F&H  implementation  for  the  KO  dynamics 


The  Gm  block  in  Figure  4-19,  is  an  active  implementation  of  a resistor  [65].  It  is  a 
simple  differential  amplifier  stage  with  emitter  degenerator  MOSFET  diodes  as  shown  in 
Figure  4-20.  These  diodes  decrease  the  Gm  value  for  the  same  bias  current  and  also  dou- 
bles the  input  linear  dynamic  range.  The  relation  between  the  input  differential  voltage 
and  de  output  current  is  defined  by  Eq.  (4-35).  This  is  a nonlinear  relationship  however  if 
the  input  difference,  (Vin+  - Vin_  ) (Figure  4-20),  is  kept  small,  it  is  reasonable  to  take 
the  derivative  of  the  tanh(.)  around  zero  resulting  in  Eq.  (4-36). 

= <4'35> 

j _ hGm  ' ( Vjn  + ~ V in  - ) 

out  ~ 4 Yt 


(4-36) 
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Figure  4-20.  Gm  amplifier  with  degenerator  diodes 

Equation  (4-37)  represents  the  Z domain  transfer  function  for  Figure  4-19.  The  very 
low  frequency  poles  (35Flz  and  1 14Hz)  were  accomplished  with  a very  low-power  imple- 
mentation ( = 100/2 W)  and  with  a fairly  low  area  expenditure  of  200pm  x 150pm 
(Cj  = 1 pF\C1  = 4 pF).  The  duty-cycle  was  set  to  1%  virtually  scaling  up  the  capacitors  by 
100.  In  Figure  4-21  the  predicted  and  measured  frequency  responses  are  shown. 


H(z)  = 


, . -(Gnl/C,p7- 

(1  -e )_ 

~(Gml/Ct)kT  -l  X 
1 - e ■ z 


,,  ~(Gnl/C2)kT 
(1  -g )_ 

-(Gm2/C2)kT  _l  X Z 

1 - e ■ z 


(4-37) 


The  poles  location,  defined  by  Eq.  (4-37),  is  linearly  dependent  on  the  sampling 
period  T and  duty-cycle  k.  Measured  results  shown  in  Figure  4-22  display  that  linear  rela- 
tionship. However,  the  slope  is  not  exactly  the  same  on  both  plots.  The  difference  is  about 
33%  and  is  mostly  due  to  duty-cycle  errors. 


Pole  Position  (Hz) 


100 


Figure  4-21.  F&H  measured  frequency  magnitude  response  together  with  the  response 

predicted  by  (4-37)  (solid) 


(l/T)/2e3 


► 

k*100 


a)  b) 

Figure  4-22.  Dominant  pole  position,  a)  Pole  variation  versus  normalized  sampling  fre- 
quency; b)  Pole  location  versus  normalized  duty-cycle  (k). 
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4.8  Summary 

In  this  chapter,  a new  class  of  filters  suited  for  the  low  frequency  dynamics  of  the 
olfactory  model  was  proposed.  The  filter  is  denominated  “Filter  and  Hold  (F&H)”  and  it 
was  shown  that  the  time  constant  x = RC  is  virtually  increase  by  1 /k  through  time 
manipulation.  The  VLSI  design  and  measurements  for  the  K0  dynamics  were  also  pre- 
sented. 


CHAPTER  5 
RESULTS 

5.1  Introduction 

The  high  level  formal  simulation  proposed  in  chapter  2 became  the  center  piece  for 
the  discrete-time  analog  implementation.  At  this  point  the  formal  high  level  representation 
can,  in  a sample  by  sample  basis,  predict  how  the  real  system  will  behave.  Thus,  the  VLSI 
system  can  be  flexibly  tested  and  the  parameters  refined  with  the  digital  simulator  which 
can  be  directly  brought  onto  the  designed  chip  by  external  active  control.  This  is  possible 
because  both  domains  share  common  mathematical  descriptions  (difference  equations  and 
Z transform),  except  that  the  DSP  representation  is  dimensionless.  However,  this  does  not 
pose  a problem  because  the  variables  are  easily  translated  (e.g.,  index  time  n in  DSP 
becomes  nT  in  the  real  domain,  and  amplitudes  are  scaled).  Of  course  this  tight  coupling 
between  the  mixed  signal  and  the  DSP  implementations  also  creates  extra  difficulties 
because  the  exact  mathematical  functions  are  seldom  implementable  in  analog  VLSI  and 
the  present  implementation  is  not  an  exception.  Hence,  the  design  cycle  has  to  include  a 
redefinition  of  the  formal  DSP  system  to  include  the  alterations  imposed  by  analog  imple- 
mentation limitations.  If  it  turns  out  that  both  representations  have  a close  fit,  the  analog 
implementation  will  be  a good  representation  of  the  original  continuous-time  model,  given 
that  previous  results  have  shown  that  the  digital  model  reproduces  well  the  Runge-Kutta 
simulation.  This  is  the  methodology  followed  in  this  chapter  that  culminates  previous 
results  in  a consistent  framework. 
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The  last  chapter  presented  a dynamical  system  that  made  possible  the  implementa- 
tion of  the  K0  dynamics  with  very  low  power  and  reasonable  area.  However,  two  more 
blocks  need  to  be  designed:  the  nonlinear  function  and  the  summing  node,  to  complete  the 
K0  cell.  This  is  the  subject  of  the  next  two  sections. 


The  function  responsible  for  the  nonlinear  characteristic  of  Freeman’s  olfactory 
model,  is  static  and  asymmetric  around  the  zero  point  (Figure  1-1).  A precise  implementa- 
tion of  Eq.  (1-2)  is  not  an  easy  task  but,  can  be  approximated  with  a modified  OTA  (oper- 
ational transconductance  amplifier).  The  exponential  sigmoid  shape  and  the  asymmetry 
around  the  input  axis  present  in  the  original  function,  are  preserved  with  this  design.  The 
exponential  shape  is  set  by  placing  the  MOS  transistor  in  subthreshold  operating  region 
where  it  displays  an  exponential  relationship  between  the  gate  source  voltage  and  the 
drain  current.  An  asymmetric  characteristic  is  accomplished  by  unmatching  the  current 
mirror  that  acts  as  an  active  charge  to  a differential  input  stage  and  shown  in  Figure  5-1. 
The  output  current  relation  with  the  input  differential  voltage  is  then  represented  by  Eq. 
(5-1),  and  is  plotted  in  Figure  5-2  for  Ib  = 1 ; N = 5;  VT  = 1 . 


5.2  Nonlinear  Asymmetrical  Sigmoid  Function 


N-e 


(Vln/VD 


-1 


Q(Vin)  = h* 


(Vin/VT) 


(5-1) 


e 


+ 1 


The  unbalancing  of  the  current  mirror  originates  the  offset  displayed  in  Figure  5-2a. 
However,  it  can  be  cancelled  by  attaching  a voltage  equal  to  the  offset  value  at  the  cell 
inverting  input.  This  voltage  value  can  be  automatically  achieved  with  a similar  cell  con- 
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nected  with  negative  feedback.  The  compensated  nonlinear  function  block  diagram  is 
shown  in  Figure  5-3.  A final  residual  offset  will  be  only  caused  to  the  natural  fabrication 
process. 


Figure  5-1.  Approximated  nonlinear  function  implementation 


Figure  5-2.  Approximated  nonlinear  function,  a)  N=5, Ib=l,  VT=1;  b)  Measured  responses 
in  the  chip  for  two  different  bias  currents  (the  bias  current  of  Gm  is  IbGm=600nA) 
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Figure  5-3.  Asymmetric  nonlinear  function  with  offset  compensation 

The  final  nonlinear  function  schematic  is  shown  in  Figure  5-4.  The  current  mirror 
gain  N,  was  set  to  5 which  is  equivalent  to  make  q{=5  in  equation  (1-2).  The  OTA  was 
implemented  using  a wide  range  topology,  to  prevent  the  current  inversion  that  occur  with 
single  stage  differential  amplifiers,  when  the  output  voltage  drops  below  a certain  value. 
The  Gm  amplifier  is  a current  to  voltage  converter.  Chip  measurements  [66]  with  two  dif- 
ferent bias  currents  are  shown  in  Figure  5-2b. 


Figure  5-4.  Implemented  asymmetric  nonlinear  function  (voltage  in/voltage  out) 
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5.3  The  K0  Cell 

The  KO  model  is  almost  complete.  To  allow  interconnectivity,  an  input  summing 
node  is  required  and  also  excitatory  and  inhibitory  KO  cells  are  needed.  The  summing 
node  is  implemented  with  a simple  inverting  voltage  adder  as  represented  in  Figure  5-5a. 
In  order  to  preserve  the  proper  sign  between  input  and  output,  the  nonlinear  circuits  were 
topologically  changed  to  preserve  the  signal  polarity.  Figure  5-5b  shows  conceptually  the 
needed  nonlinear  function  change  to  ensure  the  proper  signs  and  to  accomplish  the  KO 
excitatory  and  inhibitory  cells.  The  circuit  to  perform  these  nonlinear  functions  are  a small 
variant  of  Figure  5-4  circuit.  Only  the  unbalancing  transistors  and  input  positions  change. 
Each  designed  KO  takes  an  area  of  500 \im  x 160pm  and  the  power  consumption  is 
roughly  200 p IT  to  ensure  driving  capabilities  in  the  summing  and  output  amplifiers. 


Figure  5-5.  K0  model,  a)  Complete  K0  model;  b)  Nonlinear  function  correction  to  accom- 
modate the  signal  inversion  at  the  summing  node 

5.4  Preliminary  Results 

One  main  objective  of  this  dissertation  is  to  present  implementation  methods  that 
can  efficiently  be  used  for  physical  analog  implementations.  To  prove  this,  implementa- 
tion examples  are  needed.  All  crucial  elements  were  designed  and  tested,  however  the 
controlling  digital  signals  were  generated  externally  considering  that  this  part  is  not  the 
focus  of  this  thesis.  Furthermore  in  a full  integration  these  would  be  library  ASIC  compo- 
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nents.  The  other  external  elements  were  the  resistive  feedback  strengths.  This  is  an  impor- 
tant component  and  should  be  integrated,  however  to  facilitate  the  testing  (the  parameters 
were  not  known  a priori)  these  were  externally  placed.  Possible  solutions  will  be  the 
object  of  discussion  in  the  next  chapter,  the  future  work  section. 

5.4.1  A Single  KII  Oscillator 

A KII  set  was  built  in  analog  VLSI  with  components  described  in  the  last  sections 
and  with  the  F&H  described  in  last  chapter.  The  parameter  set  was  empirically  deter- 
mined. In  opposition  with  what  would  be  the  normal  procedure,  the  DSP  simulation  con- 
firmation (NeuroSolutions  or  Matlab)  is  done  after  the  chip  test  using  the  empirical 
parameters  found  experimentally.  In  fact,  in  terms  of  validation,  it  does  not  matter  which 
method  is  done  first,  consequently,  it  is  not  relevant  which  system  is  used  as  a parameter 
reference.  Starting  with  a working  circuit  provides  a measure  of  how  close  the  digital  sim- 
ulator proposed  in  chapter  2 predicts  the  response  and  in  the  case  of  an  unsatisfactory 
solution,  it  will  assist  in  the  search  of  what  components  should  be  modified.  All  in  all,  this 
testing  procedure  helps  to  fine  tune  the  digital  simulator  to  the  analog  implementation. 

The  circuit  and  simulator  configurations  are  shown  in  Figure  5-6a  and  Figure  5-6b, 
respectively.  Table  5-1  summarizes  the  parameter  set  used  in  this  experiment.  The  K0  lin- 
ear dynamics  in  these  experiments  had  poles  set  at  a = 1 10/ s and  b = 360/ s , and  the 
nonlinearity  was  biased  with  Ib  = 40nA  (Figure  5-2).  This  biasing  value  was  set  empiri- 
cally and  is  such  that  the  output  is  well  below  the  input  saturating  levels  of  the  F&H  Gm 


amplifiers. 
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Input 


Figure  5-6.  The  KII  model,  a)  Circuit  schematic;  b)  DSP  counterpart 


Table  5-1.  KII  interconnection  strengths 
Chip  and  digital  parameter  values 


Gain 

Value 

^F^EE=^EE 

2.5 

Rf/Rii=K,i 

2.5 

rf/rie=kie 

2 

Rf/REI=REI 

5 
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The  clock  frequency  is  set  to  fs  = 2.3 kHz(  > 2 • 7t/(20  xb)),  the  duty-cycle 
k = 1%  and  Rf  = 100&£2 . As  done  in  earlier  chapters,  an  output  is  referred  to  the  state 
of  the  system.  We  normally  define  it  at  the  dynamics  output. 

A KII  cell  is  an  oscillator  controlled  by  the  input.  The  KII  cell  oscillates  when  the 
input  energy  rises  and  ceases  oscillation  when  the  input  goes  below  a certain  value.  Figure 
5-7  plots  the  measured  response  at  the  K0E1  output  evidencing  such  behavior.  In  Figure  5- 
8 signals  measured  at  different  K0  cells  in  the  KII  are  plotted. 

On  a first  attempt,  the  digital  simulator  with  feedback  parameters  defined  by  Table 
5-1  does  not  show  a satisfactory  solution.  After  taking  the  system  out  of  the  initial  zero 
state.  Figure  5-9a  shows  that  the  output  never  ceases  oscillation  with  the  same  input  used 
in  Figure  5-7.  This  result  clearly  shows  that  the  original  DSP  blocks  are  not  appropriate 
representations  of  the  implemented  VLSI  approximations.  It  is  then  convenient  to  redefine 
some  of  these  digital  simulator  blocks  responsible  for  the  differences  to  take  into  account 
the  major  necessary  approximations  made  through  the  VLSI  design. 


Figure  5-7.  KII  chip  measurement  response  to  a pulse  input 
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Figure  5-8.  KII  measurement  at  different  outputs  during  the  oscillating  phase 
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Figure  5-9.  Simulator  response  with,  a)-  Exact  nonlinearity;  b)  Exact  nonlinearity  with 

normalized  input  and  corrected  slope 


A more  careful  analysis  of  Figure  5-2a  reveals  that  the  exact  nonlinear  function  pro- 
posed by  Freeman  has  a higher  slope  and  consequently  requires  a smaller  input  for  the 
same  saturating  output  levels.  Clearly  this  a factor  that  makes  a difference.  In  fact,  the  nor- 
malization parameter  a needed  to  match  the  slopes  of  the  two  functions  is  about  a = 1.5  . 
Furthermore,  the  implemented  nonlinearity  has  an  input  normalization  factor  of 
VT  = 25 mV,  and  a set-up  positive  saturating  level  of  80mV.  To  scale  up  this  function  to 
the  -1  and  5 saturating  levels  used  in  the  digital  simulations  of  Freeman’s  nonlinearity,  we 

have  to  make  in  Eq.  (5-1)  Ib  = 1 . The  resulting  normalizing  factor  becomes 
—3  —3 

V'T  = 5/(80  x 10  ) x 25  x 10  = 1.56 . This  scaled  up  function  has  the  same  saturat- 

ing levels  as  the  original  Freeman’s  nonlinear  function  with  q = 5 , but  with  different 
slope  due  to  the  different  normalization  of  VT  = 1.56.  If  now  we  correct  Freeman’s  non- 
linearity slope  with  an  input  normalizing  factor  of  a'  = ax  V'T  = 1.5  x 1.56  = 2.34 
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and  perform  a digital  simulation  in  the  same  conditions  as  before,  a more  satisfactory 
result  is  obtained  except  for  the  obvious  scaled  up  amplitudes  as  shown  Figure  5-9b.  The 
result  is  coherent  and  shows  clearly  that  in  the  future,  the  KO  nonlinear  function  needs  to 
be  reprogrammed  to  take  into  account  the  approximated  functions  implemented  in  the 
analog  VLSI  chip. 

Taking  in  consideration  the  approximated  nonlinear  function  and  also  the  F&H  dif- 
ference equation,  a simulation  result  in  the  same  condition  as  the  chip  measurement  is 
shown  in  Figure  5-10  and  Figure  5-11.  Comparing  these  figures  with  Figure  5-7  and  Fig- 
ure 5-8  the  similarities  are  evident.  The  main  measurable  features  are  summarized  in  Table 
5-2.  The  relative  phase  displacement  and  magnitude  ratios  are  coherent  although,  with  dif- 
ferent absolute  values.  It  should  be  noted  that  the  system  is  of  eighth  order,  which  means 
that  the  frequency  difference  (34Hz  given  by  the  simulator  and  the  38Hz  measured  from 
the  chip)  can  account  for  as  much  as  20°  phase  difference  and  2 times  in  magnitude.  In  this 
sense  the  measurements  are  consistent. 

The  major  sources  of  error  responsible  for  the  remaining  differences  observed  in 
Table  5-2  is  the  F&H  implementation  and  other  nonidealities  associated  to  all  other  com- 
ponents in  the  KO  chain.  Starting  with  the  Gm  stage  in  Figure  4-19  when  the  switch  is  “on” 
the  resulting  differential  equation  is  given  by  Eq.  (5-2).  This  is  clearly  a nonlinear  func- 
tion. Although  the  difference  vin  - v0  should  be  kept  small,  the  fact  is  that  assuming  Gm 
the  derivative  of  Eq.  (5-2)  around  vin  = 0 is  an  approximation. 


(5-2) 
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The  nonlinear  hyperbolic  tangent  function  will  have  a re-shaping  effect  on  the  sig- 
nals and  will  effectively  limit  the  signals  magnitudes.  Other  higher  order  effects  such  as 
clock  feedthrough  and  extra  delays  due  to  finite  bandwidth  of  all  the  components  have  not 
been  accounted  in  the  digital  representation.  Together  with  all  the  nonideal  effects,  is  the 
usual  parameter  uncertainty  that  is  always  associated  with  real  implementations  and  that 
affects  all  components.  Albeit  these  natural  and  unavoidable  errors  (although  perhaps 
minimizable),  the  discretization  methodology  shows  to  be  a good  prediction  of  how  the 
mixed  signal  analog  system  behaves  dynamically,  and  will  be  an  asset  for  the  analog  cir- 
cuit parametrization. 


Time  (s) 

Figure  5-10.  KII  digital  simulator  result  to  a pulse  input 
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Figure  5-11.  KH  simulator  result  at  different  outputs  during  the  oscillating  phase 
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Table  5-2.  Some  important  results  from  simulation  and  chip  measurement  (S-  represents 

the  state  magnitude) 


Feature 

Simulation 

Chip  Mea- 
surement 

S KE\/  S KE2 

1.15 

1.15 

SKE\^KI\ 

1.71 

1.69 

^KEl^Kll 

2.18 

2.00 

^KlX^KIl 

0.89 

1.28 

Ke2) 

42.6° 

30.4° 

*(KEVKn) 

86.6° 

85.1° 

Kn) 

61.8° 

48.7° 

Kn) 

-23.4° 

-36.5° 

Frequency 

38Hz 

34Hz 

5.4.2  The  Reduced  KII 

When  the  number  of  channels  in  a KII  (or  Kill)  network  increases  in  number,  two  of 
the  KO  cells,  more  specifically  K0E2  and  K0I2  in  Figure  5-6,  become  redundant  [15]. 
Removing  these  two  cells  leads  to  the  reduced  KII  shown  in  Figure  5-12.  An  experiment 
was  performed  on  this  cell.  The  parameter  set  used  in  both  chip  experiment  and  the  digital 
simulator  can  be  found  in  Table  5-3.  In  Table  5-4  some  important  dynamic  measures  are 
summarized  and  Figures  5-13  and  5-14  plot  together  the  measured  and  the  predicted 
responses  by  the  high-level  formal  simulation. 
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a)  b) 

Figure  5-12.  Reduced  KII.  a)  Circuit  schematic;  b)  DSP  counterpart 
Table  5-3.  Reduced  KII  interconnections  strengths 


Chip  and  digital  parameter  values 


Gain 

Value 

^F^IE=^IE 

2 

Rf/REi=KEi 

7.7 

Table  5-4.  Some  important  results  from  simulation  and  chip  measurements  (S-  represents 

the  state  magnitude) 


Feature 

Simulation 

Chip  Mea- 

surement 

sE/s, 

2.33 

2.14 

95.8° 

92.2° 

Frequency 

31Hz 

32Hz 

VKOE  (V) 
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Figure  5-13.  Reduced  KII  response  to  a pulse,  a)  Chip  measured  response;  b)  DSP  simula- 
tion 


Figure  5-14.  Steady-state  oscillation  response,  a)  Chip  measurement;  b)  DSP  simulation 
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Previous  results  show  that  the  normalized  dynamical  characteristics  are  similar, 
however  there  are  observable  differences  that  can  be  explained  with  the  same  arguments 
used  in  the  last  section. 

5.4.3  A Coupled  KII-KO  Cell 

The  last  results  have  shown  that  the  simulator  can  reproduce  well  the  dynamics  of  a 
real  discrete-time  analog  VLSI  implementation.  A further  step  was  taken  and  a KO  extra 
cell  was  coupled  to  a KII  as  shown  in  Figure  5-15.  This  configuration  topologically  repre- 
sent the  last  two  layers  of  Kill  (Figure  1-8).  The  parameter  set  used  in  the  experiment  is 
summarized  in  Table  5-5.  The  results  are  shown  in  Figure  5-16  and  Figure  5-17  and  rein- 
force previous  arguments. 


Input 


Figure  5-15.  Coupled  KII-KO.  a)  Circuit  schematic;  b)  DSP  counterpart 
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Table  5-5.  Coupled  KII-KO  interconnection  strengths 


Chip  and  digital  parameter  values 


Gain 

Value 

RF/rREE=KEE 

2.5 

RF/Rn=Kn 

2.5 

RF/Rie=Kie 

2 

Rf/Rei=Kei 

5 

RF^RGI=KGI 

3.3 

rf/Rig=kig 

2 

Figure  5-16.  Steady-state  oscillation  response,  a)  Chip  measurement;  b)  DSP  simulation 
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Figure  5-17.  Steady-state  oscillation  response,  a)  Chip  measurement;  b)  DSP  simulation 


5.5  The  KII  Network 

A final  experiment  is  needed  to  prove  another  important  argument  in  this  disserta- 
tion. Previously,  we  stated  that  the  discrete-time  implementation  allows  transparent  multi- 
plexing due  to  the  system  inherent  time  synchronization.  Transparent  means  that  the 
system  operates  seemingly  as  if  it  had  access  to  all  the  resources  at  all  times.  It  is  clear 
that,  for  a continuous-time  system,  multiplexing  effectively  samples  the  signals.  To  keep 
the  system  coherence  these  sampled  signals  need  to  be  filtered.  However,  if  the  system  is 
already  sample  type,  the  dead  time  in-between  sampling  instants  can  be  used  to  multiplex 


resources. 
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A two  phase  clock  is  almost  always  needed  in  analog  sampled  systems.  One  phase 
to  sample  the  input  and  another  to  update  the  system  output.  The  first  phase  can  be  multi- 
plexed and  the  outputs  updated  at  the  same  instant  on  the  second  sampling  phase  to  keep 
the  same  time  reference.  With  this  method,  a dramatic  reduction  of  the  interconnectivity 
size  is  possible  for  the  OB  and  PG  layers  of  the  Kill  olfactory  model.  This  is  the  theme  of 
the  following  sections 


Reference 
Clock-  Ck, 

Ck, 

njum  - JIM  •••  J 

•41; — i — H 1 

m 
1 ••• 

Ck, 

••• 

Ck, 

• 

••• 

P 

h 

a 

• 

Ck, 

L_ 

L 

s 

e 

1 

Ck,^u„ 

Ln_ 

fl 

n. 

• •4 

P 

h 

a 

Figure  5-18.  Multiplexing  time  clocks 

5.5.1  Network  Structure  Memory  and  Multiplexing 

For  simplicity,  the  multiplexing  concept  is  going  to  be  presented  using  reduced  KII 
cells  at  the  OB  layer.  Extending  the  method  to  the  regular  KII  and  Kill  is  immediate.  The 
first  clock  phase  (<!>!  in  Figure  4-19)  is  divided  into  n out  of  phase  similar  clocks  (with  the 
same  duty-cycle)  as  shown  in  Figure  5-18.  Each  clock  signal  Ckj  (i  = 1,  2, ...,«)  is  used 
to  update  the  F&H  first  stage  of  channel  i as  seen  in  Figure  5-19.  This  stage  works  both 
ways,  filters,  and  holds  the  signal,  for  a final  update  on  the  second  stage  originating  the 
necessary  delay.  After  the  sequential  input  update  is  ended,  all  F&H  output  cells  are 
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updated  simultaneously  on  the  second  phase  (Ckupdate  on  Figure  5-18  and  Figure  5-19). 
The  cell  output  is  then  stable  and  ready  to  be  used  on  another  input  update  cycle.  Thus,  the 
clock  method  represented  in  Figure  5-18,  separates  the  update  of  each  cell  which  is  signif- 
icant for  the  multiplexing  method.  Figure  5-19  shows  an  example  where  n KII  channels 
are  multiplexed.  In  this  particular  example  the  second  channel  would  be  the  one  to  be 
updated  (i.e.,  Ck2  is  active).  Note  that  both  excitatory  and  inhibitory  KO  cells  correspon- 
dent to  channel  2,  are  active.  The  other  channels  are  all  open,  thus  there  is  no  interference 
in-between  channels.  The  feedback  is  common  to  all  cells  but,  since  only  one  channel  is 
active  at  a time,  the  common  feedback  works  as  individual  feedback  on  each  input  sequen- 
tial update. 


Figure  5-19.  Multiplex  example  of  n reduced  KII  cells  (in  this  example  Ck2  would  be 
active  and  KII2  is  the  current  updating  cell) 
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The  unique  feedback  is  possible  because  individual  cells  share  the  same  parameter 
set,  a single  gain  component  K^g  and  Kqm  is  needed.  These  gains  are  represented  by 
Rmg,  and  Rgm  in  Figure  5-19  respectively.  The  number  of  gain  components  is  then 
reduced  from  2 • n to  2 in  a reduced  KII  network,  and  from  10  • n to  10  in  a full  KII  net- 
work. 

To  build  the  KII  network,  the  current  cell  being  updated  needs  to  have  access  to  all 
other  cells  output.  Since  the  update  is  not  simultaneous  the  interconnections  among  cells 
can  effectively  be  multiplexed  and  the  number  of  interconnections  can  be  reduced  from 
2 . (/i2  _ n)  to  2 • n [67].  Conceptually  the  procedure  is  shown  in  Figure  5-20  for  the  exci- 
tatory interconnections.  Each  KIIj  cell  represents  the  correspondent  dashed  block  in  Fig- 
ure 5-19.  A second  set  of  switches  connections  are  added  and  stay  always  “on”  at  all  times 
except  the  switch  corresponding  to  the  current  cell  update  (cell  number  3 in  Figure  5-20 
example)  because  auto-feedback  is  not  allowed.  The  inhibitory  interconnectivity  follow 
the  same  concept. 


Figure  5-20.  Multiplex  example  of  the  excitatory  interconnections  among  KII  cells  in  a 

KII  network 
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Figure  5-21.  Clock  generation  and  network  memory  setup 
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It  should  be  emphasized  that  the  sequential  update  has  no  effect  on  the  dynamical 
behavior  when  compared  to  a simultaneous  update  of  all  cells.  This  is  so  because  of  the 
two  phase  clock  update  needed  to  accomplish  the  necessary  delay.  There  is  an  input  and 
output  update  phases  that  take  T seconds  to  update  (clock  signal  with  k=x/T  duty-cycle). 
Out  of  these  time  intervals  the  signals  are  constant.  The  multiplex  just  uses  the  stop  time 
between  sampling  intervals  to  interleave  the  input  update  phase  among  the  cells.  Keeping 
the  output  update  simultaneous  shyncronizes  the  signal  time  references. 

Finally  for  the  network  to  function  as  an  associative  memory,  the  set  of  gain  param- 
eters Kmm  (Rmm)  have  to  change  from  cell  to  cell  update,  according  to  the  Hebbian  rule 
discussed  in  earlier  chapter.  Furthermore,  at  the  update  time  of  a particular  cell,  that  cell 
needs  to  have  the  correct  feedback  parameters  set  according  to  the  stored  patterns.  Thus, 
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an  external  memory  to  the  system  is  needed  to  store  the  network  topology  that  each  cell 
needs  to  see  at  the  corresponding  update  time.  This  memory  array  is  square  (i.e.,  it  needs 
to  have  n bits  and  n memory  positions,  as  many  as  the  number  of  network  channels)  and 
the  content  is  binary  because  the  possible  number  of  different  values  is  two  (the  intercon- 
nection is  set  to  an  high  or  low  value  gain).  This  solution  is  depicted  in  Figure  5-21. 

Figure  5-21  also  shows  generically  how  the  different  clock  signals  are  generated. 
The  cells  clock  signal  origin  is  common  to  all  cells,  (a  monostable)  that  is  triggered  by  a 
reference  clock  (Figure  5-18).  The  common  clock  signal  minimizes  the  timing  errors  in- 
between  cells.  The  cell  is  then  chosen  according  to  a select  signal  coming  from  a circular 
shift  register  where  the  “1”  position  defines  the  active  cell  for  input  update. 

5.5.2  Four  Channels  KII  Experiment 

The  experiment  presented  in  this  section  serves  to  prove  the  concept  described 
above,  and  also  alert  for  some  other  improvements  to  future  implementations.  The  simpli- 
fied setup  is  shown  in  Figure  5-22.  The  KII  network  is  composed  of  four  channels  and  the 
multiplexing  block  represents  the  last  section  method.  A four  channel  network  has  very 
little  capacity  concerning  possible  different  patterns  that  can  be  stored.  So,  a single  pattern 
was  stored  and  set  to  [1  0 1 0].  Consequently  the  memory  content  in  Figure  5-21  needs  to 
be  set  as  shown  in  Figure  5-23.  The  individual  KII  oscillators  were  set  by  the  parameters 
defined  in  Table  5-1,  however,  the  remaining  parameters  were  empirically  found  with  the 
help  of  the  DSP  simulator.  The  dynamic  parameters  were  set  to  a = 220 /s  and 
b = 720/5.  After  few  tentatives  with  different  parameters  a satisfactory  result  was 


obtained  with  the  set  found.in  Table  5-6. 
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Figure  5-22.  Simplified  representation  of  the  four  channels  KII  experiment 
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Figure  5-23.  Memory  set  up  for  the  pattern  [10  10] 


Table  5-6.  In-between  KII  cells  interconnections  strengths 
Chip  and  digital  parameter  values 


Gain 

Value 

^F^EEL=^EEL 

0.5 

Rf/Reeh=Keeh 

2 

Rf/Rii=Kh 

0.25 

An  input  is  applied  to  the  network  corresponding  to  the  stored  pattern.  The  result  is 
found  in  Figure  5-24.  As  expected,  the  channels  that  have  the  input  applied  evolve  into  a 
higher  magnitude  oscillation  pattern  while  the  others  oscillate  but  with  much  smaller  mag- 
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nitude.  Definitely  it  is  possible  to  be  recognized  as  a [1  0 1 0]  pattern.  It  should  be  pointed 
out  however,  that  it  is  not  easy  to  replicate  the  exact  digital  simulations  because  the  KII 
individual  cells  are  never  alike  in  an  analog  implementation.  The  consequence  is  different 
impulse  response  and  natural  frequencies  between  cells.  This  is  noted  on  the  response  dis- 
played by  channel  1 and  3 in  Figure  5-24.  The  channels  respond  differently  to  the  transient 
though,  locking  to  the  same  frequency.  Eventually,  if  the  cells  are  to  far  apart  in  terms  of 
their  natural  oscillating  frequencies,  the  lock  between  the  KII  channels  may  never  happen. 
Figure  5-25  shows  another  effect  not  expected  from  ideal  equal  cells.  Channels  coupled 
with  connections  to  form  a pattern  lock  in  phase  however,  a deviation  is  observed.  This 
deviation  means  that  the  signals  do  not  have  the  exact  same  shape. 

The  main  block  responsible  for  such  differences  is  the  nonlinear  function  that  had  to 
be  setup  individually  on  each  cell  and  care  should  also  be  taken  concerning  equalization  of 
the  offsets.  Although  not  implemented,  future  designs  of  KII  cells  should  multiplex  the 
nonlinear  block  between  all  KOs  in  order  to  make  the  dynamic  behavior  uniform,  but  more 
importantly  to  facilitate  the  network  setup.  If  many  channels  were  in  use  it  would  become 
impractical  to  adjust  each  cell  individually.  Nonetheless  it  is  shown  that  multiplexing  is 
correct,  important  and  indispensable  to  implement  realistic  KII  network  sizes. 

The  DSP  result  with  the  same  setup  is  shown  in  Figure  5-26  and  Figure  5-27.  It 
shows  a similar  response  to  the  chip  although,  as  expected,  it  does  not  show  deviations  in 
the  phase  plot  because  the  cells  are  exactly  equal.  The  DSP  signal  has  a 61Hz  frequency 
while  the  chip  measurements  present  63Hz  (although  it  can  be  adjusted  to  61Hz  by  chang- 
ing one  of  the  factors  that  affect  the  F&H  poles  position). 
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Finally,  with  the  parameter  set  used,  the  input  signal  had  to  go  below  zero  to  cease 
the  oscillation.  If  not,  the  KII  output  would  never  rest  into  a stable  value  with  zero  input. 
This  is  was  verified  in  both  DSP  and  implemented  analog  chips. 


Figure  5-24.  Measured  4 channel  multiplexed  KII  network 


VKIIj  (V) 

Figure  5-25.  Channel  3 vs.  channel  1 phase  plot 


(A)  'IIM  (A)  ‘ira 
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Figure  5-26.  The  DSP  simulation  measure  of  a 4 channel  KII  network 


Figure  5-27.  Channel  3 vs.  channel  1 DSP  simulation  phase  plot 
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5.6  Summary 

This  chapter  presented  results  that  culminate  the  DSP  simulator  and  the  analog 
implementation  in  a consistent  framework.  It  was  shown  that  the  DSP  and  chip  measure- 
ments can,  in  essence,  predict  each  other's  behaviors.  The  observable  differences  were 
also  discussed  and  a multiplexing  methodology  was  presented  to  reduce  the  number  of 
needed  resources. 


CHAPTER  6 

CONCLUSIONS  AND  FUTURE  DIRECTIONS 
6.1  Conclusion 

This  dissertation  has  presented  a design  and  implementation  framework  of  a bio- 
logic realistic  model  of  the  olfactory  cortex  proposed  by  Freeman.  It  first  started  with  a 
digital  mapping  of  the  continuous  model.  Albeit  an  approximation,  the  digitizing  method 
was  shown  to  be  effective  and  yields  digital  models  that  describe  sufficient  well  the  com- 
plex behavior  of  the  olfactory  system  to  allow  parameter  fine  tuning.  The  method  of  dis- 
cretizing the  model  is  less  computational  intensive  than  Runge-Kutta  numerical 
procedures,  but  its  most  important  feature  is  flexibility.  To  study  complex  systems,  one 
has  to  be  able  to  interact  with  the  simulator  and  eventually  change  parameters  and  topol- 
ogy. With  the  digital  model  these  changes  are  easily  accomplished  considering  that  all  ele- 
ments in  the  network  have  been  individually  modeled  and  can  be  put  together  in  arbitrary 
ways,  exactly  as  electronic  components  in  a breadboard.  The  signals  are  computed  sample 
by  sample  such  that  in  any  given  instant  of  time  the  input  sample  to  a component  is  the 
result  of  a delayed  version  of  some  other  output  in  a feedback  loop.  This  ideal  single  sam- 
ple local  memory  effectively  disassociates  the  different  blocks  facilitating  the  addition  and 
removal  of  components.  With  the  analog  representation  utilized  in  Runge-Kutta,  the  state 
space  equations  are  global  and  removing  or  adding  components  signifies  rewriting  the 
global  system. 
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We  have  also  developed  a novel  analog  VLSI  implementation  method  for  Freeman’s 
model,  which  can  be  extended  to  many  other  neuromorphic  models.  One  key  innovation  is 
to  perform  time  discretization,  but  to  keep  the  magnitude  computations  full  analog.  The 
resulting  hybrid  analog-amplitude  sampled  system  is  naturally  fit  for  multiplexing.  Recall 
that  the  most  serious  limitation  to  design  large  Freeman’s  model  in  VLSI  chips  was  the 
size  of  the  interconnect,  and  multiplexing  naturally  reduces  the  size  of  the  interconnect 
from  0(N2)  to  O(N). 

The  VLSI  implementation  and  the  digital  simulator  share  the  same  formal  system 
representation.  Then  the  analog  system’s  lack  of  flexibility  can  be  compensated  by  the 
high  level  digital  system  representation.  System  optimization  can  be  done  at  this  level  and 
the  parameters  brought  into  the  analog  system  when  finished.  Eventually,  an  integrated 
development  system  with  a computer  and  the  analog  VLSI  front-end  is  possible. 

Implementing  the  dynamic  portion  of  the  Freeman  model  posed  a difficult  chal- 
lenge. Long  time  constants  and  reduced  area  are  difficult  to  conciliate  and  area  needs  to  be 
spared  to  maximize  the  number  of  channels.  Power  is  also  an  important  variable  in  this 
equation.  Different  possibilities  were  analyzed  namely  switch-capacitor  (SC)  and  switch- 
current  (SI).  None  comply  fully  with  the  requirements.  Switch-capacitor  circuits  take  too 
much  area  and  do  not  conform  with  ultra  low  power  demands.  The  SI  is  preferred  because 
it  uses  current  signals  for  dynamics  and  algebraic  operations  are  better  attained  using  cur- 
rent mode  circuits.  But  the  gamma  kernel  implementation  displays  offset  dependence  over 
the  feedback  parameter.  The  SI  proposed  offset  compensation  scheme  has  been  shown  to 
be  very  effective.  Nevertheless,  long  time  constants  still  present  strong  difficulties  to  these 
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methods.  The  requirements  for  large  capacitor  or  transistor  ratios  limits  their  usefulness 
for  the  Freeman  model. 

The  F&H  implementation  solves  much  of  the  requirements.  By  sampling  the  inter- 
nal states  of  a continuous-time  analog  filter,  it  is  possible  to  extend  the  impulse  response 
of  the  filter  without  changing  the  system’s  passive  elements.  The  effect  is  an  equivalent 
capacitor  increased  by  the  sampling  clock  duty-cycle.  A fairly  small  and  ultra-low  power 
second  order  F&H  filter  was  designed  making  the  analog  VLSI  implementation  more  con- 
ducive to  implement  larger  Freeman  models  to  attack  realistic  problems. 

Measurements  over  the  KII  VLSI  cells,  demonstrated  that  the  responses  were  very 
similar  to  the  digital  simulator  solution,  establishing  the  high  level  formal  equivalence 
among  both  domains.  The  multiplexing  methods  were  proven  effective  showing  that,  in 
computational  terms,  multiplexing  is  a transparent  method. 

The  analysis  of  the  computational  properties  of  the  Freeman  model  is  just  being  ini- 
tiated. Experimentation  is  a fundamental  task  to  probe  theoretical  aspects  and  test  hypoth- 
esis. We  have  created  a valuable  framework  for  this  inquiry  which  will  help  find  and 
formulate  the  essential  computation  paradigm  used  in  Freeman’s  model. 

6.2  Future  Directions 

Much  remains  to  be  done  in  understanding  Freeman’s  olfactory  model  as  an  infor- 
mation processing  system.  The  capacity,  speed  of  recall,  robustness  and  processing  power 
of  the  model  needs  to  be  quantified.  Interpretation  of  the  network  signals  is  also  extremely 
important.  The  internal  representations  need  to  be  further  investigated,  and,  before  any- 
thing, an  optimal  readout  is  fundamental  to  accomplish  meaningful  functions.  Future 
research  will  have  to  concentrate  on  the  functional  behavior  for  information  processing. 
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As  of  recently,  the  model  has  been  used  for  memory  association  but,  model  robustness  and 
accuracy  needs  assessment,  and  the  results  should  be  validated  with  other  known  systems. 
The  DSP  simulator  plays  an  important  role  here  because  it  is  a flexible  test  bed  for  experi- 
ments and  probing  of  the  different  theories  and  theses  that  will  grow  as  the  understanding 
matures  about  the  model.  The  dynamical  behavior  of  the  Freeman  model  depends  on  the 
system  parameters,  and  thus  a system  parameter  refinement  of  the  model  should  be  per- 
formed using  optimization  methods  such  as  backpropagation  [68]. 

We  believe  we  have  specified  and  built  the  platforms  that  will  help  answer  some  of 
these  questions.  Nonetheless  some  other  design  problems  need  to  be  addressed.  As  the 
number  of  cells  increase,  the  digital  control  grows.  It  is  necessary  to  determine  if  the  digi- 
tal control  should  share  the  same  chip  die  with  the  analog  circuitry,  or  otherwise  should  be 
generated  externally  on  a different  chip.  The  last  choice  seems  more  promising  for  two 
reasons.  First,  with  less  digital  components  sharing  a common  substrate,  less  digital  noise 
will  be  coupled  to  the  analog  circuits.  Secondly,  more  space  is  available  for  extra  chan- 
nels. But  this  approach  raises  the  problem  of  the  number  of  input  lines.  A selecting  line 
per  each  channel  is  impractical,  so  a coded  address  line,  maybe  multiplexed,  is  needed  to 
save  chip  pins.  This  will  require  a communication  protocol,  that  can  also  eventually  lead 
to  multichip  set  implementations. 

The  spatial  averaging  that  occurs  at  every  cell  of  a network  needs  also  to  be 
addressed.  If  the  number  of  channels  increase,  the  averaging  gains  drop  dramatically 
which  may  cause  implementation  limitations.  Finally,  different  active  resistive  loads  [69] 
have  to  be  investigated  to  allow  continuous  changes  on  the  system  parameters.  A critical 
point  element  that  affects  the  performance  of  KII  (or  Kill)  network  is  nonlinearity  which 
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is  responsible  for  most  of  the  differences  between  cells.  It  is  difficult  to  physically  match 
them.  However  if  a single  nonlinear  block  is  shared  among  all  KOs  then  we  will  have  uni- 
form behavior  and  it  will  simple  to  set  up  the  system.  This  can  be  accomplished  with  extra 
multiplexing  of  this  block  and  adding  an  extra  sample  and  hold  to  represent  the  output  of 
each  KO. 


APPENDIX  A 

INTRODUCTION  TO  SWITCH-CAPACITOR  AND  SWITCH-CURRENT  CIRCUITS, 

AND  DESIGN  METHODS 


A.l  Introduction 

This  appendix  introduces  different  discrete-time  techniques  commonly  used  in  ana- 
log VLSI  systems.  It  also  introduces  the  main  nonideal  effects  that  degrades  the  perfor- 
mance and  methods  commonly  reported  in  literature  to  minimize  those  effects. 

A.2  Switch-Capacitor — Introduction 

Switch-capacitor  (SC)  [39^11]  is  probably  the  most  popular  technique  utilized  for 
filtering.  The  principle  of  periodically  switching  a capacitor  charge  between  two  nodes 
has  been  known  for  more  than  one  hundred  years  [70]  as  a way  to  achieve  an  equivalent 
resistor.  In  this  sense,  any  active  filter  could,  in  principle,  be  implemented  with  this  tech- 
nique by  simply  substituting  each  resistor  with  the  equivalent  achieved  through  the  capac- 
itor switching.  Technological  problems  kept  the  technique  from  realization  (until  the 
beginning  of  the  1970’s  [71]).  Good  switches,  linear  capacitors  and  very  high  opamp  input 
impedances  are  necessary  for  optimal  results.  Bipolar  only  technologies  do  not  fulfill 
these  requisites,  especially  in  terms  of  the  opamps  input  base  currents.  However  these 
more  prominent  aspects  can  be  found  in  MOS  technologies.  Other  types  of  filters,  such  as 
the  continuous-time  filters  like  Gm-C  [72]  or  MOSFET-C  [69],  have  also  been  widely  uti- 
lized. More  recently,  techniques  like  log  domain  filters  [73,74],  exponential  state  space  fil- 
ters [75]  and  other  current  mode  filters  [76]  have  also  been  reported.  However,  if  time 
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constant  precision  is  a concern  then  SC  is  the  preferred  technique.  If  a filter  with  time  con- 
stant T = RC  (R-  for  resistor,  C-  for  capacitor)  is  designed  with  resistors  and  capacitors, 
then  a great  precision  on  x should  not  be  expected.  The  precision  is  hindered  with  the  fab- 
rication process  of  an  integrated  circuit.  Resistors  and  Capacitors  follow  different  fabrica- 
tion procedures.  This  means  that  the  errors  associated  with  yield  defects  do  not  track  each 
other  making  the  precision  of  the  product  RC  very  difficult  to  control.  For  these  reasons, 
active  continuous-time  filters  in  general  need  tuning  (e.g.,  with  automatic  procedures  [77]) 
in  order  to  achieve  a precise  frequency  response.  In  opposition,  ratios  of  capacitors  can  be 
made  as  precise  as  0.1%  [78].  The  capacitor  ratios  are  the  time  constants  in  SC  filters. 

As  the  “switch”  word  indicates,  SC  circuits  are  discrete-time  signal  processors  (but 
with  analog  amplitudes).  The  SC  technology  has  the  necessary  scalability,  addition,  inver- 
sion and  delay  properties  that  are  fundamental  and  strictly  necessary  to  implement  dis- 
crete-time linear  systems.  These  individual  elements  are  in  general  embedded  in  the 
topology  circuit  and,  in  principle,  cannot  be  found  explicitly  (such  as  a delay  block).  In 
fact,  the  most  direct  way  to  build  an  SC  filter  is  by  drawing  a realization  of  a continuous- 
time filter  H(s ) and  then  substituting  the  resistors  with  the  SC  counterparts  resulting  in  an 
H(z).  If  the  sample  frequency  is  made  infinite  then  H(z)  | _ ^wT  —■ > H(s) . 

A direct  way  to  find  an  SC  topology  is  to  find  a realization  of  H(z)  based  on  the 
(z  - l)-1  blocks  [79].  This  is  the  more  basic  memory  block  and  is  represented  by  a simple 
opamp  with  a feedback  capacitor. 

A.2.1  The  SC  Resistor 

The  basic  principle  to  achieve  an  equivalent  resistor  using  charge  switching  can  be 
easily  understood  using  the  classical  example  of  Figure  A-l. 
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This  example  has  to  regard  the  fundamental  assumptions  that  is  made  to  any  SC  cir- 
cuit. It  is  assumed  that  the  voltages  Vj(t)  and  V2(t)  do  not  change  during  the  “on”  phase  of 
<E>1  and  02  respectively.  On  each  phase  the  respective  switch  will  be  closed  and  connect- 
ing the  capacitor  in  parallel  with  the  proper  analog  voltage  source.  A non-overlapping  two 
phase  clock,  Ol  and  02,  is  needed,  and  the  clock  period  T is  chosen  according  to  the 
Nyquist  criterion  [80]  (the  input  voltages, Vj(t)  and  V2(t),  have  to  be  band  limited).  The 
key  variable  for  the  analysis  is  the  capacitor  (or  capacitors)  charge  variation  during  the  dif- 
ferent clock  phases.  Given  the  charge  Q=CVc  and  applying  circuit  analysis  techniques, 
such  as  charge  conservation  principles,  the  system  equation  is  reduced  to  a difference 
equation  where  the  states  are  node  voltages  defined  at  the  sampling  time  intervals: 

[....(«- l)r,  (n  - 1/2)T,  nT,  (n+  1/2),...]. 

Consider  Figure  A-l.  The  capacitor  charge  variation  when  Swj  closes  (<>1  is  “on”) 
is:  aq,  = Qfinal-Qprtvious  = cv,  - cv2  = C(v,-v2)Lngphaseoi  (assuming  that  the  capacitor  was 
previously  charged  to  V2).  The  same  happens  during  02  phase: 
A n-o  -o  = cv^-cv,  = c(v,-v,)|  = -A£), . This  is  repeated  every  T 

- U/ina,  Upr'vious  - ^V2  c v\  ^ V2  l;|during phase  d,2  V J 


seconds. 
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age  current  is  the  charge  variation  per  unit  sampling  time  T.  Because  the  voltage  sources 
do  not  change  during  the  sampling  time  then: 


average 


^1-^2 

T/C 


(A-l) 


Vt-V7 

Req  = j1 - = T/C  (A-2) 

1 average 

Considering  T/C  as  an  equivalent  resistor  is  valid  if  Vj(t)  and  V2(t)  remain  constant 
for  all  time  t or  as  long  as  fv/fs  « 1 where  fv  is  the  maximum  frequency  of  V}(t)  and  V2(t), 
and  f = l/T.  This  is  a high  sampling  frequency  approximation  and  can  always  be 
applied  to  an  SC  circuit  to  find  its  analog  (amplitude  and  time)  counterpart. 

In  general,  Eq.  (A-l)  does  not  hold  because  the  over-sampling  assumption  is  not 
valid.  In  this  situation  an  H{z)  can  be  defined. 

A.2.2  Simple  SC  Integrator 

An  integrator,  such  the  one  of  Figure  A-2a,  can  be  used  to  find  the  SC  counterpart 
by  replacing  the  resistor  R with  the  equivalent  SC  resistor  realization  (Figure  A-l)  result- 
ing in  the  integrator  of  Figure  A-2b.  The  total  charge  at  time  f j = (n  - 1 )T  in  both  capac- 
itors, Ci  and  C2,  referred  to  the  plates  connected  to  virtual  ground  during  02,  is: 

Qtl  = ClVil(n-l)71-C2V0[(n-3/2)T]  = ClVi[(n-l)T]-C2V0[(n-l)T]. 
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Figure  A-2.  First  order  SC  integrator,  a)  Conti nuous-time  integrator;  b)  Equivalent  SC 

integrator 


At  time  t2  = ( n-l/2)T  the  total  charge  is  Qt2  = -C2V0[(n  - 1/2)7] . This 
charge  is  only  dependent  on  C2  because  Cj  is  shorted  between  ground  and  the  opamp  vir- 
tual ground.  Because  of  the  non-overlapping  clock  characteristic  and  the  infinite  opamp’s 
input  impedance,  the  total  charge  Qtl  at  t,  = (n-l)T  can  not  be  lost  at 
t2  = (n- 1/2)7  . According  to  the  charge  conservation  principle  then  Qt2  = Qn. 
Knowing  that  V0[(n-  1/2)7]  = V0(nT)  then  the  resulting  difference  equation  is  Eq. 
(A-3)  and  the  correspondent  H(z)  is  defined  by  Eq.  (A-4). 

C1V,.[(n-l)r]-C2V0[(n-l)r]  = -C2V0(nT)  (A-3) 


ci  1 

= rr 


(A-4) 


If  the  over-sampling  condition  is  satisfied,  then  the  following  expansion  of  Eq.  (A- 


4)  is  legitimate: 
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(A-5) 


C2  jwT  jwC2R 
R = T/C, 


Equation  (A-5)  shows  that  if  the  over-sampling  condition  holds,  the  continuous-time 
integrator  of  Figure  A-2a  is  reasonably  approximated  by  the  SC  integrator.  If  not,  the  sys- 
tem should  be  characterized  with  discrete-time  tools. 

The  SC  resistor  realization  shown  in  Figure  A-l  is  not  unique.  There  are  other  possi- 
ble resistor  implementations  such  as:  series,  series-parallel,  bilinear  SC  resistors  [81].  The 
switching  procedure  of  Figure  A-l  or  Figure  A-2,  although  simple,  is  seldom  used 
because  it  is  sensitive  to  parasitic  capacitors.  Any  capacitor  connected  in  parallel  to  a low 
impedance  node  or  to  a virtual  ground  does  not  influence  the  integration  constant.  How- 
ever, Cpl  represented  in  Figure  A-2b,  participates  directly  in  the  charge  sharing  because  it 
appears  in  parallel  with  Cj  in  both  clock  cycles.  In  order  to  eliminate  the  effect  of  this 
capacitor  a parasitic  insensitive  switching  [82-84]  is  needed.  The  new  switch  is  shown  in 
Figure  A-3.  During  phase  <F1,  Cpl  and  C{  both  charge  to  the  voltage  Vj.  During  phase  d>2 
the  charge  of  CL  is  transferred  to  C2  but  not  Cpl  which  is  shorted  to  ground  by  Swj.  Con- 
versely, Cp2  is  either  grounded  through  Sw2  or  connected  to  a virtual  ground,  not  partici- 
pating with  any  charge  to  C2.  Thus  the  integrator  of  Figure  A-3  is  insensitive  to  parasitic 


capacitors. 
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Figure  A-3.  Non-inverting  parasitic  insensitive  SC  integrator 


A.2.3  The  SC  Gamma  Filter 

Previous  sections  have  briefly  introduced  the  principle  and  analysis  of  SC  circuits. 
In  this  section  a gamma  filter  example  is  presented.  For  convenience,  the  gamma  kernel 
equations,  both  in  the  time  domain  and  in  the  Z domain,  are  rewritten  in  Eq.  (A-6)  and  Eq. 
(A-7). 


If  p < 1 Eq.  (A-7)  represent  a lossy  integrator.  This  can  be  implemented  by  adding 
an  SC  resistor  around  C2  (Figure  A-3)  and  shown  in  Figure  A-4 


xk(n)  = (1  -p)  -xk(n-  1)  + p-x*_!(n-  1) 


(A-6) 


(A-7) 


Figure  A-4.  Lossy  integrator  (gamma  filter  with  p < 1 ) 
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Applying  previous  procedures  the  following  difference  equation  is  obtained  (mak- 
ing Cj  = C3  = C): 


(C2  + C)Va[nT]  = C2V0[{n  - 1)71  + CV^n  - 1 )T]  <=> 
o V0[nT]  = (1  - p) Va[(n  - 1)71  + |iV,[(n  - 1)71 


(A-8) 


H{Z)  = 


(A-9) 


The  lossy  integrator  guarantees  that  the  gamma  kernels  are  always  stable  since 
p.  < 1 as  Eq.  (A-9)  attests.  To  scale  |X,  C2  should  be  variable. 

A more  general  gamma  kernel,  where  p can  assume  any  value,  can  be  built  as  pro- 
posed in  Figure  A-5.  The  opamp  Op!  and  Cs/h  form  a sample  and  hold.  The  difference 
equation  and  corresponding  transfer  function  are  defined  in  Eq.  (A-10)  and  (A-ll), 
respectively  (Cj  = C3  = C). 
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VJnT]  = (1  -n)VJ(n  - 1 )T]  + nV,[(n  - 1)7] 


c 


(A- 10) 


(A-ll) 


If  C2  is  made  variable,  the  |X  value  can  be  greater  than  1 however  in  this  case  care 
should  be  taken  concerning  stability.  The  circuit  of  Figure  A-5  was  designed  using 
ORBIT — MOSIS  2.0(1  technology.  In  order  to  test  the  circuit  with  several  time  constants, 
multiplexers  were  used  to  program  the  C2  and  C values  [78].  The  overall  circuit  is  shown 
in  Figure  A-6. 


Figure  A-6.  Programmable  gamma  kernel 
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In  Figure  A-6,  di  and  dt  i= 0..3,  are  digital  voltages  assuming  the  values  “0”  or  “1”. 
These  voltages  control  the  multiplexers  to  program  the  p parameter  of  the  gamma  filter 
which  can  be  defined  by  Eq.  (A- 12).  The  capacitor  values  were  chosen  to  encode  seven 
different  values  of  p.  Since  and  C3  (Figure  A-5  and  Figure  A-6)  can  assume  two  differ- 
ent values,  another  seven  p values  are  encoded,  making  a total  of  fourteen  different  p val- 
ues. Depending  if  d3  is  “1”  or  “0”,  p will  be  smaller  or  greater  than  1,  respectively. 


,(3-40 

p = — (A- 12) 

(2  \ 

I £2'’  • 

<i  = 0 > 

The  chip  was  designed  with  three  gamma  taps  in  cascade.  Figure  A-7  and  Figure  A- 
8 shows  the  measured  results.  The  results  were  shown  to  be  within  3%  precision  on  the 
time  constant.  The  offset  is  about  60mV.  The  error  on  the  time  constant,  due  to  capacitor 
imprecision,  can  be  observed  with  p=8/4,  which  is  the  stability  limit.  The  expected  result 
should  be  a steady  oscillation  (pole  at  z=-l),  however  the  measured  signal  was  still  high- 
pass  with  damped  overshoot.  For  p>2  the  output  saturated  as  expected. 


Amplitude  (V) 
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Figure  A-7.  Gamma  filter  result  with  (4=1/7 
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Figure  A-8.  Measured  result  for  jx=8/4 

A.3  Charge  Injection  (Clock  Feedthrough  CFT) 

The  simplest  component  in  sampling  systems,  the  switch,  is  also  the  largest  source 
of  offset,  gain  errors,  and  noise.  Howbeit  these  nonidealities,  the  MOS  (or  CMOS)  switch 
is  a fundamental  piece  that  helps  sampled  systems,  such  as  SC,  to  succeed.  The  switches 
commonly  utilized  in  VLSI  sampled  systems  are  shown  in  Figure  A-9. 


_c — 1 
_r l 

"LF  A 

n±£r 

CMOS  Switch 


Figure  A-9.  Different  types  of  MOSFET  switches 
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Between  the  NMOS  and  PMOS  switches  there  are  no  substantial  differences.  How- 
ever, they  impose  a real  limitation  on  dynamic  range.  If  the  clock  O varies  between  0 and 
Vdd  the  maximum  signal  voltage  allowed  at  the  source  of  the  NMOS  switch  is  V dd  - Vth 
(with  V[h  the  threshold  voltage).  For  the  PMOS  switch  the  minimum  voltage  would  be 
Vth . With  these  switches  the  dynamic  range  cannot  span  the  full  power  supply  range  and  it 
is  further  aggravated  by  the  body  effect  [85]  which  increases  the  | Vth\  value.  Since  the 
NMOS  has  an  upper  signal  limit,  and  the  PMOS  limitation  is  at  the  lower  end  of  the  sig- 
nal, placing  these  two  switches  in  parallel  (Figure  A-9 — CMOS  switch)  the  dynamic 
range  will  span  the  power  supply.  When  the  NMOS  cuts-off  at  V dd  - Vth , the  PMOS  will 
be  conducting  up  to  Vdd.  At  the  lower  end  the  opposite  occurs.  When  both  transistor  are 
conducting  the  switch  equivalent  resistor  is  the  parallel  of  each  isolated  equivalent  value, 
lowering  the  effective  resistor  value  of  the  switch.  The  drawback  is  that  it  needs  an  inver- 
sion of  the  clock  signal  d>  and  a bit  more  area  which  per  se  is  not  of  great  importance  when 
contrasted  with  the  single  transistor  switch. 

Although  MOS  switches,  in  general,  present  good  switching  solutions,  they  are  not 
without  dynamical  shortcomings.  The  dynamic  nonideal  effects  associated  with  MOS 
switches  eventually  becomes  the  cause  for  signal  to  noise  ratio  (S/N)  deterioration,  offsets, 
gain  errors  and  distortion.  Ultimately  the  effect  responsible  for  these  specification  limits  is 
charge  injection  also  called  clock  feedthrough  (CFT)  [55-57,40]. 

A.3.1  Charge  Injection 

The  best  way  to  understand  the  nonideal  phenomenon  of  charge  injection  is  to  con- 
sider a simple  sample  and  hold  (S&H)  shown  in  Figure  A- 10. 
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S&H  Schematic  S&H  with  the  MOSFET  physical  representation  (transversal  cut) 


Figure  A-10.  Sample  and  hold  (S&H)  circuit  (physical  representation  when  <£>=”on”) 

When  the  <I>  clock  signal  is  “on”,  the  transistor  accumulates  inversion  charge  under 
the  gate  allowing  the  capacitor  to  charge  up  to  the  input  voltage  Vin.  Since  it  is  assumed 
that  the  “on”  state  of  the  clock  is  at  a voltage  value  such  that  VGS  > Vth , then  the  MOS- 
FET transistor  will  be  in  the  linear  region  ( VDS  < (VGS  - Vth) ) because  VDS  — » 0 . In  this 
situation  the  transistor  charge  distributes  “uniformly”  along  the  channel  from  the  source 
(S)  up  to  the  drain  (D). 

The  error  occurs  when  the  transistor  goes  into  the  “off’  state  (when  O transits  from 
“on”  to  “off’  state).  When  <I>  goes  to  “off’  state,  the  charge  in  the  channel  under  the  gate 
has  to  disappear,  withholding  any  current  from  flowing  and  the  transistor  is  “off’  (assum- 
ing zero  charge  for  VGs<V'h’  which  is  not  true  but  a good  approximation  under  the  con- 
siderations). This  charge  will  obviously  be  deviated  or  injected  into  the  drain  and  source 
circuit  paths,  causing  then  the  charge  injection. 

The  injected  charge  into  Vin  (Figure  A-10)  does  not  generate  errors  because  Vin  is 
assumed  to  be  a low  impedance  driving  source  and  its  value  will  not  change.  However, 
such  will  not  be  the  case  on  the  capacitor  side.  The  extra  charge  coming  from  the  transistor 
channel  will  be  algebraically  added  to  the  charge  already  there,  changing  the  stored  volt- 
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age.  Under  this  circumstance  the  equality  V0  = Vin  is  no  longer  valid  and  a sampling 
error  occurs.  If  the  clock  signal  transit  states  fast  enough,  it  can  be  assumed  that  half  the 
channel  charge  is  injected  into  the  capacitor.  The  voltage  change  due  to  this  charge  can  be 
quantified  as  Eq.  (A-13)  [81]. 


AV 


■WI'-(VDD-  V,„  - [ VlU>  i T(712»fl  + vi.  - WM 

2 C 


(A-13) 


Although  the  process  and  modeling  of  the  charge  injection  is  more  complex  than  it 
is  apparent  from  Eq.  (A-13),  it  illustrates  well  the  detraction  effect.  The  more  important 
aspect  of  the  charge  injection  is  the  nonlinear  dependence  (square  root)  of  the  error  volt- 
age with  the  input  signal  Vin.  Inevitable  harmonic  distortion  will  result. 


A. 3.2  Clock  Feedthrough  from  Overlap  Capacitive  Coupling 

A more  correct  model  can  be  derived  for  the  dynamical  nonidealities  using  the  sche- 
matic of  Figure  A-ll[56].  Although  we  are  not  going  to  derive  the  exact  model  [56],  it 
illustrates  well  the  CFT  process.  During  the  drain  and  source  area  etching  and  implanting 
fabrication  process,  some  of  the  gate  will  overlap  into  these  areas  with  a length  extent 
denominated  by  lateral  diffusion  length  (LD  in  Figure  A- 10).  The  overlap  can  be  model  as 
a capacitive  coupling  between  the  gate,  drain  and  source  with  a value  defined  by: 
CGSovl  = ^GDovi  = W • Ld  • Cox.  The  capacitor  CG  (Figure  A-10)  represents  the  gate 
capacitor  (CG  = W-  L - Cgx).  With  the  transistor  in  the  “off’  state  there  is  no  more 
charge  in  the  channel  however,  due  to  CGSovi  and  CGDovl,  there  will  still  be  charge  change 
in  C during  the  transition  period  when  d>  goes  from  Vin  + V*  to  zero  Volt.  The  charge 
injection  caused  by  the  overlap  capacitors  before  the  transistor  cuts-off,  is  negligible 
because  the  gate  capacitor  is  much  bigger  than  the  overlap  capacitors.  Nevertheless,  they 
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are  the  elements  solely  responsible  for  clock  coupling  when  the  control  voltage  goes 
below  the  threshold  voltage.  The  equivalent  model  for  CFT  when  O < ( Vin  + Vth ) is  rep- 
resented in  Figure  A- 12  [56],  If  the  clock  transition  is  very  fast,  the  error  voltage  due  to 
the  overlap  capacitors  can  be  defined  by  Eq.  (A- 14). 


a \r  ^ GDovl  I/ 

AVo  = r Tc'Vdd 

L GDovl  + c 


(A- 14) 


S&H  Schematic  S&H  Model 

Figure  A-ll.  S&H  model  for  clock  feedthrough  [56] 


<D 


Figure  A- 12.  The  S&H  model  when  d>  < Vin  + Vth 
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The  error  voltage  AV0  is  approximately  independent  to  the  input  voltage.  In  this  case 
the  overlap  capacitors  will  only  be  accountable  for  offsets. 

A.3.3  Control  over  CFT 

Control  over  CFT  is  very  limited  however,  there  are  trade-offs  and  a few  circuit 
solutions  that  the  designer  should  be  aware  in  order  find  the  best  possible  compromise. 
According  to  the  above  exposition  and  with  the  help  of  equations  (A-13)  and  (A-14)  the 
following  summarized  points  should  be  considered: 

• AV0  increases  with  transistor  area.  This  is  evident  from  Eq.  (A-13)  and  from  the 
actual  value  of  CGDovi.  As  the  area  increases  so  increases  CG  which  will  in  turn 
raise  the  inversion  charge.  The  area  as  to  be  a trade-off  between  “on”  resistance 
and  CFT  error.  In  general  the  operation  frequency  will  dictate  the  highest  “on” 
equivalent  resistor. 

• AV0  decreases  with  the  increase  of  the  sampling  capacitor  value.  The  control  of 
AV0  through  C value  has  implications  on  chip  area  and  on  the  time  it  takes  to 
charge  the  capacitor  up  to  Vin. 

• AV0  depends  on  the  input  voltage.  The  signal  dependence  is  nonlinear  as  evi- 
denced in  Eq.  (A-13)  resulting  in  harmonic  distortion.  Lowering  Vjn  will  diminish 
harmonic  distortion  but  has  implications  on  dynamic  range  and  S/N. 

• The  slower  the  transitions  of  the  clock  d>  the  lower  is  the  CFT.  This  is  not  apparent 
from  above  the  explanations,  however  from  the  model  of  Figure  A- 11  the  state- 
ment is  made  clearer.  In  this  model  the  charge  change  in  the  channel  of  the  transis- 
tor is  modeled  by  a nonlinear  resistor,  R^,  dependent  on  the  controlling  voltage 
[56].  In  this  sense,  if  the  transition  is  made  slow  some  of  the  error  charge  injected 
into  C can  be  retrieved  by  V;n  through  R^. 

• If  V,n  is  not  an  ideal  voltage  source  then  the  CFT  increases  with  its  internal  resis- 
tance Rs.  This  point  is  directly  related  with  the  last.  This  resistor  will  come  in 
series  with  R^  increasing  the  time  constant. 
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Circuit  procedures  to  reduce  CFT  are  limited.  The  dummy  switch  [86,87]  is  a classic 
solution  often  used  (Figure  A- 13).  When  O switches  to  “on”  state,  M2  will  be  cutting  off 
and  its  channel  charge  is  retrieved  by  Vin  through  Ml.  However  when  d>  switches  to  “off’ 
half  of  Ml  channel  charge  will  be  injected  into  C.  Yet  M2  is  turning  “on”  and  since  its  size 
is  half  of  Mis  that  charge  is  going  to  be  absorbed  by  M2  gate  capacitor.  Thus  ideally  no 
charge  injection  affects  the  capacitor  C.  In  reality  transistor  mismatch  will  limit  greatly  the 
configuration  efficiency. 


Vin 


®i — [> — \\f~ 

_n — l 


M2  (dummy  switch) 


Ml 


I 


Figure  A-13.  Cancellation  of  dynamical  switch  errors  with  dummy  switch 


CMOS  switches  can  also  be  used  for  CFT  cancellation  (Figure  A-9).  Due  to  the 
complementary  clock  characteristic  and  knowing  that  PMOS  and  NMOS  transistors  have 
channel  charges  of  opposite  sign,  in  principle  charge  injection  would  be  eliminated.  How- 
ever cancellation  with  CMOS  switches  demands  for  precise  control  over  the  complemen- 
tary clocks  [81]  and  symmetry  is  difficult  to  attain. 

The  best  solution  is  to  use  full  differential  topologies  [88].  An  example  of  such  a 
structure  is  found  in  Figure  A-14  representing  the  same  integrator  in  Figure  A-3.  The 
transfer  function  is  unaltered  but  at  least  the  common  mode  signals  at  the  input  of  the  full 
differential  amplifier  will  be  attenuated.  However  the  signal  dependent  nonidealities  that 
do  not  represent  common  mode  signals  will  eventually  limit  the  linearity  and  noise  perfor- 
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mance.  An  obvious  disadvantage  with  full  differential  topologies  is  the  need  for  double 
resources  and  consequently,  area,  complexity,  and  eventually  power  degradation.  None- 
theless, the  differential  nature  is  accountable  for  doubling  the  dynamic  range,  and  for  bet- 
ter distortion  performance  [72,81].  Additionally,  by  simply  changing  the  voltage  relative 
references,  an  inverted  version  of  the  signal  is  obtained  avoiding  the  need  for  extra  circuit 
inverting  procedures. 


V,(t) 


-V0(t) 


1.4  Technological  Evolution  and  its  Implications  on  Analog  Design 
The  continuous  pressure  for  more  integration  of  bigger  and  more  complex  systems 
requires  simpler  circuit  content,  with  greater  area  efficiency  and  technology  down  scale 
for  miniaturization.  Technological  feature  sizes  down  scaling  has  strong  implications  on 
device  parameters.  This  condition,  combined  with  the  fact  that  these  technologies  are 
mostly  optimized  for  digital  operation,  makes  the  implementation  of  analog  functions  con- 
siderably difficult.  At  submicron  sizes,  the  short  channel  effect  is  very  strong,  making  the 
analyses  more  difficult.  This  does  not  represent  a real  problem  for  analog  design  because 
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the  transistors  can  be  made  bigger.  However,  miniaturization  has  stronger  implications  at 
other  levels.  For  example,  when  the  length  of  a transistor  is  made  too  small,  punchthrough 
effect  can  occur  [85].  The  phenomenon  can  be  observed  as  a strong  increase  of  current  as 
the  VDS  (Drain  Source  voltage)  increases,  which  is  a direct  consequence  of  source  and 
drain  depletion  regions  closeness  in  a short  length  condition.  To  circumvent  the  punch- 
through  problem  these  depletion  regions  should  be  made  smaller.  It  can  be  achieved  by 
decreasing  reverse  bias  voltages  and  increasing  substrate  doping  concentration  [85].  The 
bias  condition  implies  lower  power  supply  voltages.  The  increased  doping  increases 
threshold  voltage,  which  may  be  corrected  by  making  the  gate  insulation  oxide  thinner. 

Punchthrough  is  not  the  only  factor  to  condition  the  technology  parameters.  Impact 
ionization,  which  is  more  severe  for  small  devices,  and  hot  carrier  effects  are  also  condi- 
tioning factors.  Especially,  the  latter  degrades  the  device  performance  permanently  and 
results  from  accumulation  of  charge  in  the  oxide.  The  charge  gets  trapped  and  never 
leaves  (even  when  the  device  is  powered  off)  with  adverse  consequences  (e.g.  threshold 
voltage  increase).  This  charge  is  injected  from  high  energy  carriers  (either  holes  or  elec- 
trons) called  hot  carriers  generated  from  high  electric  fields  and  are  directly  related  with 
the  bias  voltages  (VGS  - Gate  Source  voltage  and  VDS).  All  these  phenomena  are  observed 
above  a given  “threshold”  or  breakdown  voltage,  implying  limitations  on  devices  operat- 
ing voltages.  Futhermore  with  the  increase  digital  scale  of  integration  and  the  consequent 
increase  in  power,  it  further  pushes  for  low-voltage  technologies. 

Thus  it  is  clear  that  the  constant  miniaturization  to  accommodate  a need  for  bigger 
integrated  systems  has  strong  implications  on  device  technological  parameters  and  voltage 
operations.  The  implications  on  analog  design  are  now  evident.  Dynamic  range  is  lost  and 
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consequently  the  signal  to  noise  ratio  (S/N)  degrades,  making  the  design  of  analog  func- 
tions with  high  S/N  and  high  speed  together  very  difficult  (e.g.,  making  the  design  of  the 
cascode  cells  difficult).  As  the  technology  scales  further  down  eventually  the  threshold 
voltage  has  to  be  scaled  for  speed  requirements  [89]  and  obviously  optimized  for  digital 
performance,  which  may  prove  to  be  another  extra  burden  for  analog  designers. 

Nevertheless,  no  matter  how  big  a digital  system  is,  there  will  be  always  a portion  of 
it  that  has  to  be  analog  at  the  interface  level  with  the  outside  analog  world.  Due  to  the  tech- 
nological evolution  mentioned  earlier,  it  means  that  new  methods  of  analog  design  have  to 
be  developed  to  resolve  expected  difficulties.  There  are  some  clever  applications  where 
analog  memory  cells  [90]  are  utilized  to  level  shift  the  threshold  voltage  [91],  or  the  cur- 
rent mode  methods. 


1.5  Current  Mode  Circuits — a Possible  Solution 
Switch-current  circuits  proposed  by  Hughes  et  al,  [42]  are  a possible  method  to 
avoid  low  voltage  problems  through  operation  in  the  current  domain.  The  idea  is  based 
again  on  the  fact  that  the  low  voltage  operation  requirements  makes  the  design  of  voltage 
mode  circuits,  with  high  linearity  and  dynamic  range,  rather  difficult.  To  avoid  large  volt- 
age swings  a low  impedance  analog  circuit  is  used  with  current  as  the  signal  instead  of  the 
voltage.  These  can  operate  at  lower  power  supplies  because  the  current  flows  through  low 
impedance  nodes  making  the  voltage  swing  small  [43].  This  factor  also  has  implications  in 
frequency  since  lower  impedance  in  the  signal  path  means  a wider  frequency  band. 
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Other  current  mode  for  general  purpose  applications  (as  opamps)  have  also  been 
reported.  Such  cells  are  denominated  current-conveyor  by  Sedra  and  Smith  [92-94]  and 
can  be  used  to  perform  useful  signal  processing  applications  [43]. 


In  the  linear  discrete-time  signal  processing  sense,  switch-current  (SI)  circuits  is  an 
universal  technique.  It  finds  applications  in  analog  to  digital  converters  [95]  and  also 
reports  on  SI  multipliers  [96]  are  available.  Implementations  either  in  CMOS  or  BiCMOS 
technologies  have  also  been  reported  [97]. 

Any  difference  equation  can,  in  general,  be  implemented  with  this  technique.  The 
fundamental  computational  ingredients  such  as  the  delay  block  (memory),  summation, 
inversion,  and  scaling,  are  available.  The  SI  sampling  blocks  have  similarities  with  the 
current  copier  circuits  [98,99]  and  was  proposed  originally  by  Hughes  et  al  [42].  The  basic 
principle  of  a SI  circuit  is  very  simple.  Consider  the  current  mirror  amplifier  of  Figure  A- 
15.  It  complies  with  the  requisites  of  a low  input  impedance  and  large  output  impedance 
current  amplifier. 


1.6  Switch-Current  Filter 


Figure  A- 15.  Scaled  1:A  current  amplifier 
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Node  1 in  Figure  A- 15,  represents  the  input  summing  node.  The  summed  current 
flows  through  transistor  Mj,  is  mirrored  into  M2  and  scaled  by  a factor  A.  Finally  the  out- 


put current  is  ia  = aj-a 


n \ 


j + 


S 0 = ~A'  ZO-  Thus,  the  current  amplifier  of  Figure  A- 15 

/ » i ' ; = i 

accomplishes  the  summation,  scaling  and  inversion  needed  for  linear  discrete-time  signal 
processing.  The  delay  can  be  accomplished  with  the  switching  procedure  of  Figure  A-16. 


The  memory  operation  is  performed  by  sampling  the  gate  source  voltage  of  M2  tak- 
ing advantage  of  the  unavoidable  MOS  gate  capacitor  (seen  dashed  in  Figure  A-16)  to 
hold  that  voltage.  To  understand  better  the  sampling  procedure  take  in  consideration  Fig- 
ure A-17  [100]. 


Figure  A-17.  The  SI  track  and  hold  operation,  a)  Track  phase;  b)  Hold  phase 
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When  the  clock  signal  d>  goes  into  “on”  state  at  t - 0 (s) , the  NMOS  switch  is  in 
the  linear  region  shorting  together  the  gates  of  and  M2  (Figure  A- 17a).  During  this 
phase  (0  < t < 77 2)  the  SI  memory  cell  is  working  as  a current  amplifier  (Figure  A-15) 
where  M2  equals  Mfs  current  (apart  from  a possible  scale  factor  if  the  gain  needs  to  be 
other  than  1).  The  output  current  is  tracking  the  input  in  this  phase. 

The  NMOS  switch  cuts-off  when  the  O transits  into  an  “off’  state.  The  gate  capaci- 
tor Cg  will  be  holding  the  voltage  it  had  just  before  the  switch  opened  at  t = 7V 2 ( s ) , 
holding  the  output  current.  Thus,  during  the  period  77 2 <t<T  (Figure  A-17b),  denomi- 
nated holding  period,  the  output  current  is  constant  and  equal  to  the  input  at 
t = T/2  ( s ) . The  complete  cycle  can  then  be  formalized  according  to  Eq.  (A-15).  With 
the  added  switch  in  Figure  A- 16,  the  four  basic  processing  operations  are  then  realized: 
summing,  scaling,  inversion  and  memory,  z 1/2 . 


i0(t)  = -A  - 2 I/O;  0<t<T/2 

j=  1 

n 

i 0(t)  = -A  - £ ij(T/2);  T/2<t<T 


(A-15) 


There  are  basically  two  practical  occurrences  that  limit  the  SI  accuracy,  the  device 
mismatch  and  clock  feedthrough.  The  next  sections  will  try  to  expose  some  the  sources 
and  possible  “solutions”. 


A.6.1  Device  Mismatch 

Consider  the  equation  of  a NMOS  transistor  working  in  strong  inversion.  The  drain/ 
source  current  is  defined  by  Eq.  (A- 16). 
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(3  2 W 

x(l+XVrfs)  P = ^-r  (A*  16) 

Consider  for  reference  Figure  A- 15.  This  figure  represents  the  T/H  (track  and  hold) 
cell  of  Figure  A-16  when  the  switch  is  “on”.  This  is  a critical  state  because  a transference 
of  current  from  input  to  the  output  with  minimal  error  is  intended.  In  an  ideal  situation  the 
following  equalities  have  to  hold  in  order  for  the  error  to  be  minimal  (the  subscript  num- 
bers 1 and  2 correspond  to  transistors  Mj  and  M2,  respectively)  [101]: 


W i W2 

1.  Device  aspect  ratios:  A • — = — 

Ll  L2 

2.  Threshold  voltages:  VtX  = va 

3.  Transconductance  parameter:  KNl  = KN2 

4.  Channel  length  modulation  parameter:  Xj  = \2 

5.  Drain  source  voltage:  V*1  = Vds  2 

Violations  of  the  above  equalities  will  bring  gain  distortion  and  DC-offset  errors 
[102].  Points  1 and  5 are  variables  that  the  designer  can  manipulate.  The  other  variables  in 
points  2,  3,  and  4 are  related  with  the  technology  which  are  premises  for  the  designer.  All 
points  are  assumed  as  true  for  the  designer,  especially  2 through  4,  however  in  practice 
during  the  fabrication  process  of  an  integrated  circuit,  uniformity  of  parameters  at  differ- 
ent points  of  the  chip  is  not  expected.  In  fact  due  to  fabrication  variations  [101,103],  any 
of  the  five  points  presented  will  ever  be  matched  in  space.  Devices  in  different  locations 
will  have  different  technological  and  physical  parameters.  What  the  designer  can  and 
should  do  is  try  better  designs  that  may  attenuate  the  effects  by  making  the  circuits  more 
independent  from  the  largest  sources  of  mismatches. 
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A.6.2  Mismatch  Reduction  in  CAD  Design 

During  the  CAD  design  some  care  must  be  taken  to  reduce  the  mismatches  men- 
tioned above.  An  example  is  to  use  common  centroid  geometries  [39].  The  transistors  to 
be  matched  are  partitioned  into  several  transistors  in  parallel.  They  are  then  cross  distrib- 
uted around  the  same  area  putting  the  transistors  in  the  same  space  variation  conditions 
(Figure  A- 18). 


Figure  A-18.  Schematic  of  a common  centroid  geometry  for  a differential  pair 


The  disadvantage  with  the  common  centroid  design  is  the  extra  area  required  by  the 
splitting  procedure.  It  requires  the  transistors  to  be  placed  further  apart  which  also  is  a 
condition  to  avoid  when  possible.  A better  approach  would  be  the  use  of  stacked  layout 
[104].  A schematic  example  is  shown  in  Figure  A-19  for  a current  mirror. 


Figure  A-19.  Schematic  of  a stacked  layout  for  a current  mirror  (each  transistor  in  the 
stack  is  1/4  of  the  original  isolated  transistor  size  W/L) 
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With  the  stacked  layout  procedure,  unitary  transistors  are  connected  in  parallel.  To 
improve  the  matching,  the  unitary  transistors  are  interdigitized  to  equally  distribute  the 
spacial  parameters  variation  among  the  equivalent  transistor  pair.  This  technique  can  fur- 
ther be  combined  with  common  centroid  geometry. 

Splitting  a transistor  into  unitary  pieces  has  further  benefits.  It  makes  the  aspect  ratio 
of  the  transistor  more  manageable  for  layout,  it  reduces  the  total  parasitic  capacitance  due 
to  drain  and  source  implant  areas,  and  it  improves  the  ratio  sizes  precision  of  a transistor 
pair  [104,64]  (A  = (W2/L2)/(W1/L1)  in  Figure  A-15).  The  same  is  achieved  with  lin- 
ear capacitor  design.  However,  it  is  not  expect  similar  matching  accuracy  because  more 
steps  are  required  to  build  transistors. 

The  relative  position  of  the  matching  transistors  is  also  important.  If,  for  example, 
one  of  the  transistors  is  rotated  90°  with  respect  to  the  other,  as  much  as  2%  current  mis- 
match results  [101].  In  general,  the  geometric  position  of  the  sources  and  drains  relative  to 
each  other  is  important  [44].  Figure  A-19  shows  that  along  the  stack  the  drains  and  sources 
alternate  in  orientation.  For  this  reason,  when  the  stacked  layout  is  used,  the  number  of 
split  transistors  should  be  even  [44].  With  even  number  of  transistors,  half  of  the 
drains(sources)  will  be  to  one  side  and  the  other  half  to  the  opposite  side,  equalizing  the 
effects. 

During  the  fabrication  process,  the  etching  procedure,  that  defines  the  gate, 
overetches  the  thin  oxide  under  the  polysilicon  gate  material.  This  process  is  boundary 
dependent  [104],  Because  the  transistors  on  the  periphery  and  the  innermost  transistors  of 
the  stack  are  affected  differently,  mismatch  occurs.  However,  the  mismatch  can  be  attenu- 
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ated  by  putting  dummy  transistors  at  both  ends  of  the  stack  to  equalize  the  boundary 
geometry  (Figure  A-19,  MD1  and  MD2)- 

A.7  Reducing  Mismatch  Electronically 

Simple  mathematical  manipulations  to  better  understand  the  influence  of  the  diverse 
matching  variables  present  in  all  VLSI  designs,  can  be  performed  [100,102],  giving  much 
insight  into  the  matching  problem.  Having  in  mind  Figure  A-15,  the  gate  source  voltage  of 
M!  is  Eq.  (A-17)  and  the  output  current  is  going  to  be  given  by  Eq.  (A-18).  With 
Vgs2  = VgSl  substituting  Eq.  (A-17)  into  Eq.  (A-18)  results  in  Eq.  (A-19). 


V„1  = V„  + J f,  (A-17) 

i = 1 

i„  =A-J-Id,  2 = AJ-^(Vgn- Va)\l  +XVds2)  (A-18) 


02  1 + ^2^ds2 

Pi  ' 1 +^I 


1+^,2 


AV,  • gm2  ■ 


( (71  . 1+X2Vd*} 

W ’Pi’vi  + ^w 


igm2  = j2A$2J] 

Uv,  = Vn-vj 


(A-19) 


In  an  ideal  situation,  Eq.  (A-19)  should  be  reduced  to  ia  = -A-  i = -A-  £ ij . But 

7 = 1 

instead,  harmonic  distortion  will  occur  due  to  the  nonlinear  square-root  dependence  of  the 
output  with  the  input  current  (third  term  on  right  hand  side  of  Eq.  (A-19)).  Considering 
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that  the  input  signal  is  small  enough  to  neglect  the  Early  effect  X,  the  technological  param- 
eter responsible  for  the  harmonic  distortion  is  the  threshold  voltage  mismatch 
A Vt  = Vn  - V,2  ■ It  is  obvious  that  as  the  ratio  i/J  gets  smaller  then  smaller  is  the  effect 
of  the  square-root  in  the  overall  equation.  So  if  the  biasing  current  J is  increased,  the  THD 
(total  harmonic  distortion)  and  gain  error  will  decrease  [105].  The  other  technological 
parameters  will  only  cause  DC  offset.  The  increase  of  the  biasing  current  J in  relation  to 
the  signal  current  i,  will  further  make  the  variation  of  Vds  less  dependent  on  the  output  sig- 
nal current.  However,  making  i/J  small  will  obviously  inflict  a penalty  on  the  dynamic 
range  and  power. 

A new  configuration,  which  greatly  improves  the  matching  properties  of  the  track 
and  hold  (T/H)  circuit  (Figure  A-16),  was  proposed  by  Hughes  et  al  [106].  It  is  named 
“Second  generation  Switch-current”  cells.  The  method  is  based  on  the  current  copier 
[98,99]  and  the  dynamic  current  mirror  [107]  and  virtually  eliminates  the  matching  prob- 
lem inherent  to  the  T/H  circuit  of  Figure  A-16.  The  new  cell  is  shown  in  Figure  A-20 

The  operation  is  as  follows.  When  Sj  and  S2  closes,  M1  is  diode  connected  and 

offers  a low  impedance  path  for  the  input  current,  that  charges  the  capacitor  Cg  with  the 

necessary  Vgs  voltage  for  that  current  (7  + i(- ).  When  these  switches  open  and  S3  closes, 

Mj  will  be  a current  source  given  by  Eq.  (A-16)  where  Vgs  is  the  voltage  previously  stored 
—1/2 

in  Cg,  so  iQ  = z i, . Since  the  current  sink  and  current  source  is  performed  with  the 
same  transistor,  the  mismatch  problems  discussed  in  Section  A.6.1  are  virtually  inexistent. 
Nonetheless,  when  scaling  is  needed  or  the  current  needs  to  be  duplicated,  a mirror  is  nec- 
essary. Thus,  the  memory  cell  is  improved  with  the  second  generation  configuration  how- 
ever, the  scaling  will  eventually  introduce  all  the  problems  discussed  in  Section  A.6.1. 
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Figure  A-20.  Second  generation  SI  cell 


A.7.1  CFT  in  SI  Circuits 

The  CFT  in  SI  circuits  is  in  all  similar  to  SC  circuits.  Thus,  all  considerations  made 
in  Section  A. 3. 3 to  control  the  CFT  can  be  directly  applied  to  the  SI  circuits.  However,  one 
simple  rule  should  be  added:  making  the  DC  Vgs  large  (by  either  increasing  the  bias  cur- 
rent J or  decreasing  W/L)  reduces  CFT.  The  Vgs  increase  also  contributes  to  improve  the 
THD  and  gain  errors  due  to  threshold  voltage  mismatch. 

Some  interesting  strategies  have  been  proposed  to  cancel  the  CFT.  One  of  the  first 
circuits  proposed  to  cancel  the  signal  independent  (offset)  CFT  is  represented  in  Figure  A- 
21  [102],  A dummy  memory  cell  generates  a bias  current  corrupted  with  CFT  component. 
This  current  is  then  subtracted  to  the  actual  output  signal  current.  Thus,  the  resulting  out- 
put current  will  be  exempt  of  signal  independent  CFT.  This  method  has  a very  limited 
applicability  because  it  relies  on  the  matching  between  the  two  cells,  which  is  difficult  to 


realize. 
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Figure  A-21.  Clock  feedthrough  cancellation  using  current  replica 


A similar  technique  that  is  able  to  cancel  the  signal  dependent  CFT  to  some  extent, 
is  shown  in  Figure  A-22  [108].  The  input  signal  is  memorized  in  two  identical  cells  but 
with  size  ratios  of  1:2  (if  the  ratio  were  1:1  the  added  signal  at  the  output  would  be  zero). 
When  the  cell  currents  are  added  together,  and  if  the  CFT  current  is  the  same  in  both  cells, 
the  CFT  will  be  cancelled.  However,  this  method  suffers  from  the  very  same  matching 
problem  discussed  for  the  current  replica  cancellation  technique. 


Figure  A-22.  Signal  dependent  CFT  cancellation  using  the  current  replica  technique 

The  most  utilized  technique  to  cancel  the  CFT  with  single  ended  signals  is  the  so 
called  S2I  switch-current  cells  [109]  (or  the  more  general  n-step  charge  injection  cancella- 
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tion  [110]).  The  S2I  switch-current  is  illustrated  in  Figure  A-23  for  an  S2I  half  clock  (z"1/2) 
memory  cell. 


<E>, 


3>, 


lb 


Figure  A-23.  The  S2I  half  clock  memory  cell 


The  memory  is  a two  step  procedure,  namely  the  coarse  and  fine  steps  [109].  The 
primary  principle  is  that  during  the  phase  clock  <I>la  transistor  is  “memorizing”  the 
input  current  and  M2  is  sourcing  the  bias  current  J (Sj,  S2  and  S5  are  closed).  During  d>la 
phase  clock,  the  gate  capacitor  of  M2  will  be  holding  a memory  of  the  bias  voltage  Vb. 
This  is  named  the  coarse  memory  period.  When  the  switch  S2  and  S5  opens,  a current 
/,  = J + i + At  will  be  flowing  through  Mj,  where  Ai  represents  the  CFT  injected  noise 
when  the  switches  open.  The  fine  step  is  during  <I>lb.  At  this  stage,  the  voltage  at  the  gate 
of  M2  has  to  change  to  equalize  the  extra  current  Ai.  Thus,  the  current  at  M2  will  now  be 
I2  = J + At . At  the  end  of  the  fine  phase  all  switches  are  open  except  S3  that  will  be  clos- 
ing. If  no  CFT  were  injected  by  opening  S4,  the  CFT  error  to  the  output  would  be  zero  and 
independent  of  the  input  signal.  In  reality  it  will  not  be  zero  but  much  less  than  any  other 
technique  presented  so  far.  The  only  CFT  in  the  output  will  be  caused  by  S4  with  a signal 
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dependence  on  Ai  that  should  be  A i « (i,  J ) . Consequently  this  technique  is  almost  free 
from  CFT  errors. 

Still,  the  best  procedure  to  reduce  the  errors  for  sampled-data  systems,  is  the  fully 
differential  circuits.  Examples  of  such  cells  can  be  found  in  [111-113]  or  more  recently 
[114]. 

A.7.2  Finite  Input  and  Output  Impedance 

One  important  cause  for  errors,  not  yet  mentioned,  is  the  input(output)  and  out- 
put(input)  conductance(impedance)  ratio.  If  an  SI  cell  has  a high  input  impedance  and  a 
low  output  impedance,  a good  input/output  current  transfer  is  not  expected  when  two 
z~W2  cells  are  cascaded.  For  an  optimal  current  drive  and  sink,  the  input  conductance 
should  be  as  high  as  possible  and  the  output  close  to  zero.  An  increase  of  the  input  conduc- 
tance can  be  achieved  using  voltage  amplifiers  to  increase  the  loop  gain  of  the  diode  con- 
nected transistors  [113,115].  This  technique  is  often  used  in  amplifiers  to  decrease  the 
output  stage  open-loop  impedance  [116].  The  method  is  efficient  but  voltage  feedback 
defeats  the  purpose  of  low  voltage  and  large  bandwidth  operation  in  current  mode  circuits. 
A different  option  is  to  increase  the  output  impedance  (decrease  gout)  and  techniques  such 
as  the  cascode  and  high-swing  cascode  [42]  are  the  most  common  methods. 


APPENDIX  B 

THE  SI  LOCAL  OFFSET  CLOSE  FORM  OUTPUT  EQUATION 


This  appendix  presents  the  close  form  derivation  for  the  SI  gamma  local  offset  can- 
celing scheme  of  Chapter  3.  For  convenience  equations  (3-7)  and  (3-8)  are  rewritten  here 
in  Eq.  (B.l)  and  Eq.  (B.2). 


Oi(n) 


Ao/l 

(l-^)[02(n-l)-Oi(n-l)]  + Xo/i 


yn  even 
yn  odd 


(B.l) 


02(n)  = 


(l-H)[Oj(n-l)-02(n-l)]  + X, 


of 2 


vofl 


,n  even 
yn  odd 


(B.2) 


To  find  a close  form  solution  for  these  equation  a few  iterations  have  to  be  per- 
formed over  Eq.  (B.l)  and  Eq.  (B.2).  From  these  a close  form  can  be  intuited.  With  the 
result  a proof  by  induction  is  sufficient  to  attest  the  validity  of  the  close  form. 

Assume  that  the  initial  conditions  are  Oj(-l)  = Xj,  02(- 1)  = X2  and  that  the 
time  starts  at  n = 0 . According  to  equations  (B.l)  and  (B.2),  the  iterative  Eq.  (B.3)  can  be 
found.  The  close  form  equations  have  to  be  considered  for  the  sequences  n odd  and  n 
even,  consequently  two  hypothesis  have  to  be  tested,  for  n even  and  n odd.  After  some 
minor  manipulations,  the  following  thesis  is  proposed. 


169 


170 


n = 0 = even  ■ 


n = 1 = odd  — > 


n = 2 = even  — » 


n = 3 = odd 


0,(0)  = Xo/, 

o2(0)  = ( 1 - H)  • (X,  - X2)  + xoy2 

0,(1)  = (l-n)2-(X,-X2)  + (l-n)Xoy2-(l -tf-Xofl+Xofi 

o2(  1)  = xoy2 

0,(2)  = Xo/1 

Oz(2)  = (l-H)3-(X1-X2)  + (l-^)2-Xoy2-(l-^)2-Xo/1  + (l-ti)X<:,/1- 
.(l-(x)Xoy2  + Xo/2 

0,(3)  = (1  - (X)4  • (X,  -X2)  + (1  - n)3  • X0/2-(l  - H)3  • Xon  + (1  - (X)2  • Xo/i  - 
( 1 - jx)2  • Xofl  + ( 1 - IX)  • Xofl  - ( 1 - |x)  • Xofl  + Xo/, 

02(3)  = Xaj2 


(B.3) 


n = 4 = even  — > 


0,(4)  = Xo/, 

02(4)  = (1  -(X)5  • (X,  -X2)  + (1  -ix)4  • XoJ2-(l  -IX)4  ■ Xofx  + (1  -^)3  • X„fl  - 
( 1 - ^)3  • Xofl  + ( 1 - ix)2  • Xofl  - ( 1 - ix)2  • X„fl  + ( 1 - |x)  • Xofl  - ( 1 - n)  • Xof2  + Xofl 


B.1.1  Thesis 


B.l  Close  form  proof  by  induction 


The  close  form  of  Eq.  (B.l)  and  Eq.  (B.2)  is  represented  by  Eq.  (B.4)  and  Eq.  (B.5). 


n = even  — > 


o,(»)  = xofl 


( n 


n + 1 


02(n)  = (1  — M-)  • (X,  -X2)  + 


£[(l-H)*-(-l)*] 

v*  = o 


■*ofi  + 


( n 


- 22  [(!  -•*)*  * <-D*l + 1 

v * = o 


'of 1 


(B.4) 


0,00  = (i  - M-)"  + 1 • (X,  -X2)  + 


10  - H)*  •(-!)*] + 1 


' XoJ2  + 


^ 4 = 0 


n = orf<i 


( n 


^[(1-H)*(-1)*1 
V4  = 0 


V»/l 


02(»)  = Xofl 


(B.5) 
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B.1.2  Hypothesis 

If  n is  even  then  Eq.  (B.6)  is  observed. 


n + 1 = odd 


( n + l 


n + 2 


<?,(«+!)  = d“H)  ‘.(X,-X2)  + 


Id -!*)*•  (-0*1  + 1 

^ * = o 


XoJ2  + 


(n*  1 


£ [(1  -JX)*  - (-1)*] 
V*  = 0 

o2M  = xofi 


v»/i 


(B.6) 


Otherwise,  if  n is  odd  Eg.  (B.7)  is  observed. 


n + 1 = even  — > 


0,(n+l)  = *„/, 


/"n  + l 


n + 2 


02(«+l)  = (l-|i)"T  ■(X,-X2)  + 


= 0 


*0/2  + 


( n + l 


[(1  - |*)‘  • (-1)*]  +1 

^ i = 0 


'■ofl 


(B.7) 


B.1.3  Proof  of  the  hypothesis  veracity 

• The  first  elements  of  the  series  are  n = 0 and  n = 1 . Taking  these  values  into 
equations  (B.4)  and  (B.5),  respectively,  results  in: 


0,(0)  = xofl 

02(  0)  = (l-|x)-(Jf,-X2)  + Jfoy2 


(B.8) 


| o,(i)  = + (B  , 

io2(l)  = xof2 

This  result  matches  the  one  for  n = 0 and  n = 1 in  Eq.  (B.4). 

/.  Equations  (B.4)  and  (B.5)  are  representations  for  the  first  element  of  (B.l)  and 


If  n is  even  then  n + 1 is  odd.  Taking  Eq.  (B.4)  and  substituting  in  Eq.  (B.l)  and 
Eq.  (B.2)  for  n odd  results  in: 
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n + 2 


0,(«  + 1)  = (1-H)',T  •(X,-X2)  + 


^ = 0 


*0./2  + 


W = o 

02(»+l)  = Xof2 


(B.10) 


■ Xofl  - ( 1 “ + Xof\ 


Making  the  change  of  variable  j = k+  1 and  knowing  that  (-l/  1 = -(-l/,  Eq. 
(B.10)  results  in  Eq.  (B.ll)  after  some  simplifications,  which  is  the  same  as  the  hypothesis 
Eq.  (B.6). 


( n + l 


n + 2 


O^n  + l)  = (1-^)"T  •(X,-X2)  + 


-XlO-n/l-i/l 

V;=i 


*0/7  + 


'n  + 1 \ 

^ [(1  - (-1/1 
V=  i 

02(n+l)  = Xofl 


' Xof\  + Xofl 


<=> 


( n + l 


n + 2 


0,(»+i)  = (1  -I*)  (Xl-X2)  + 


-X  [(1  -d- (-!)']  +1 

v j = o 


Xofi  + 


/n  + l 

Xio-ii/i-i/i 

V = o 

02(n  + 1 ) = Xgj2 


'of\ 


(B.ll) 


The  same  is  true  if  the  procedure  is  applied  for  n odd. 

The  thesis  is  then  proven  to  be  true  and  equations  (B.4)  and  (B.5)  represent  Eq. 


(B.l)  and  Eq.  (B.2)  for  all  n. 


APPENDIX  C 

NONIDEAL  SI  LOCAL  OFFSET  CLOSE  FORM  OUTPUT  EQUATION 


This  appendix  presents  the  close  form  derivation  for  the  SI  gamma  local  offset  can- 
celing scheme  of  Chapter  3 with  non-ideal  gains.  For  convenience  equations  (3-17)  and 
(3-18)  are  rewritten  here  in  Eq.  (C.l)  and  Eq.  (C.2). 


Xofl 

yn  even 

(C.l) 

A,  • (1  -(!)•  [02{n-\)-aOx(n-  l)]  + Xo/1 

tn  odd 

[A2(l  -n)  • [0,(n-  l)-a02(n-  l)]  + Xo/2 

^ even 

(C.2) 

[X0fi 

yn  odd 

To  find  a close  form  solution  for  these  equation  a few  iterations  have  to  be  per- 
formed over  Eq.  (C.l)  and  Eq.  (C.2).  From  these  a close  form  can  be  intuited.  With  the 
result  a proof  by  induction  is  sufficient  to  attest  the  validity  of  the  close  form. 

Assume  that  the  initial  conditions  are  Oj(-l)  = Xj , 02(-l)  = X2  and  that  the 
time  starts  at  n = 0 . According  to  equations  (C.l)  and  (C.2),  the  iterative  Eq.  (C.3)  can  be 
found. 

It  should  be  noted  that  it  was  considered  in  Eq.  (C.l)  and  Eq.  (C.2)  that  the  final  off- 
sets, XofT1  and  Xofr2,  on  the  reference  phase  are  approximately  equal  to  Xofl  and  X^,  as 
shown  in  Chapter  3. 

The  close  form  equations  have  to  be  considered  for  the  sequences  n odd  and  n even, 
consequently  two  hypothesis  have  to  be  tested,  for  n even  and  n odd.  After  some  minor 
manipulations,  the  following  thesis  is  proposed. 
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n = 0 = even  — > 


0,(0)  = xofl 

02(  0)  = A2-(l-n)(X,-aX2)  + Xoy2 


n = 1 = odd  — * 


n = 2 = even  — > 


J 0,(1)  = A,A2(l-n)  •(Xl-aX2)  + AI(l-|i).XoiJ-/ll(l-rta-X^+X„/1 

lo2(l)  = xof2 

0,(2)  = Xofl 

02( 2)  = A,A2(1  -ji)3  • (X,  -aX2)  + A,A2(l  -n)2  Xo/2-A,A2(l  -\i)2a  -Xofi  + 
A2(  1 - n)  • Xo/x  - A2(  1 - jx)a  • Xof2  + Xoy2 


n = 3 = orfrf  — > 


n = 4 = even— > 


0,(3)  = A^(l-^)4-(X1-aX2)  + A^A2(l-n)3X0/2-A^A2(l-ti)3aX0/1+  (C-3) 

A , A2(  1 - n)2  • Xo/1  - A , A2(  1 - n)2a  • Xof2  + A , ( 1 - (i)  • XQfl  - A , ( 1 - |i)a  • X^  + Xo/1 
02(3)  = Xof2 

0,(4)  = Xo/1 

02(4)  = A^(l-n)5-(X,-aX2)  + A^(l-n)4X0/2-A^(l-n)4aX0/1  + 

A,A2(  1 - H)3  • Xoyl  -A,A2(  1 - n/a  • Xof2  + A,A2(  1 - H)2  • Xof2  - A ,A2(  1 - n)2cc  • Xofl  + 

A2(  1 - n)  • Xo/,  - A2(  1 - H)a  • Xof2  + Xoy2 


C.  1 Close  form  proof  by  induction 


C.1.1  Thesis 


The  close  form  of  Eq.  (C.l)  and  Eq.  (C.2)  is  represented  by  Eq.  (C.4)  and  Eq.  (C.5). 


n = even  — » 


0,(«)  = Xofl 

02(„)  = A(,"/2)A(2n/2  + 1>(l-(x)n  + 1-(X1-aX2)  + 

n/2 

Y [d-ti)2*-(A,A2)t]  Xo/2  + 

* = 0 


(n/2 


-a  ■ 


^ [(1  -|x)^2*  + 1^  • A,A2t+1^]  -(1  -^)(b  + 1>Aj"/2)A2i/2+1^ 
^ = 0 


■Xofl* 


(n/2 


Y [( 1 - \i){2k  + l)  • A,A{/+  °]  - (1  - n)(n  + 1)A(,"/2)A(2n/2+  0 


\t  = o 


xofl  + 


(n/2 


Y [(l-li)2*-(A,A2)*]-l 
^*  = 0 


'of\ 


(C.4) 


-a  • 
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n = odd 


(4^)  («+U 

0,(n)  = (A,A2)  (1-H)  (X,-aX2)  + 

,n  - 1 


,n  + 1 

yk=i 

Ti-l  ,n  + 1 

2 

£ [(l-H)2*  (A,A2)*]-a- 
\k  = 0 U = 1 

02(»)  = V 


^[(l-^)2t(A,A2)*]-l 


jfe  = o 


£[(i-n)(2*  • a*a2*  n] 


Xofl  + 


'■ofl 


(C.5) 


C.1.2  Hypothesis 


If  n is  even  then  Eq.  (C.6)  is  observed: 


n + 1 = odd 


(4^)  (»  + 2) 

(?,(*)  = (A,  A2)  (1-h)  • (X,  -aX2)  + 

,n  + 2 , n 


,n  + 2 


£[(1-H)(2*  1>-A*A*_1]-a- 
* = l 

f 2 

£[(l-H)2*(A,A2)*]-cx- 
v*  = o 

02(n)  = Xof2 


Y\ 


]£[(!-  M-)2* ' (A,A2)*]  - 1 


* = o 


Xofl  + 


£[(l-|i)(2*  • a*a2*-1)] 


* = 1 


K0f\ 


(C.6) 


Otherwise,  if  n is  odd  Eq.  (C.7)  is  observed: 
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n + 1 = even  — H -o. 


0|(  0)  = *o/1 

(i±i)  r«±i+I) 

02(n)  = A,  A2  2 (l-n)("  + 2)-(X,-aX2)  + 


n + 1 


£ [(i-h)2*  (a,a2)*] 


k-0 


■Xofl  + 


,n  + 1 


^ [(1  -n)*2t+1^  ■AjAj**1^]-!!  _jx)^"  + 2)A^n  + 1)/2)A2"  + 1)/2  + 1^ 


k~0 


xof2  (C.7) 


+ 1 


^(l-/+1)-A^tl»l-A(,(-tI,/X,tl)/U1) 


k = 0 


yofl 


,n  + 1 


-a 


X [(1-H)2*  (AjA2)*]-1 


* = 0 


lo/l 


C.1.3  Proof  of  the  hypothesis  veracity 

• The  first  elements  of  the  series  are  n = 0 and  n = 1 . Taking  these  values  into 
equations  (C.4)  and  (C.5),  respectively,  results  in: 


0.(0)  = Xofl 

O2(0)  = A2(  t — t1)  ■ (%i  ~ + ^0/2 


(C.8) 


10,(1)  = A,A2(1  -H)2  ■ (X,  -aX2)  + A,(l  -n)  -X0f2  + Xg^  -aA,(l  -U)  • Xg ^ ^ ^ 

lo2(l)  = XoJ2 

This  result  matches  the  one  for  n = 0 and  n = 1 in  (C.4). 

Equations  (C.4)  and  (C.5)  are  representations  for  the  first  element  of  (C.l)  and 

(C.2) 


• If  n is  even  then  n + 1 is  odd.  Taking  Eq.  (C.4)  and  substituting  in  Eq.  (C.l)  and 


Eq.  (C.2)  for  n odd  results  in: 
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n = even  — > 


*o/2  + 


0,(»)  = *o/i 

02(«)  = (A1X2r^‘'(I-rt"'-.(X1-aX2)  + 

( n/2  \ 

£ [(l-|i)<“+1)-A»+,,A*] 

v*  = o 

/n/2 

-a-  £ [(l-n)(2*  + 2)  (A1A2)(*+1)]-(l-n)("  + 2)(A1A2)(n/2  + 1) 
\k«0 

fji/2  ' 

X [(l-Ji)(2i  + 2)-(A1A2)(i+1)]-(l-Ji)(',  + 2)(A1A2)("/2+1)  x0/1 

\t  = 0 y 


vofl 


(n/2 


-a 


£ [(1-H)(2*+1)  A(*+1)A2]-1 


v*  = o 


'■ofl 


(C.10) 


making  the  change  of  variable  j = k+  1 , equation  (C.10)  and  after  some  simplifications 
results  in  (C.ll),  which  is  the  same  as  the  hypothesis  equation  (C.6). 
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n + 1 = odd  — > 


0,(n)  - X0fx 

f{L±Jl 

\ 2 J (n  + 2) 

02(n)  = (A,A2)  ( 1 — M-)  + 


XoJ2~ 


(n/2  + 1 

Vy=l 

/n/2  + 1 A 

(n  + 2)..  . .(n/2+1) 


a 


X [( 1 - vr  ■ iAfai)  - ( 1 - nr  (*  1*2) 


v j= i 

/n/2  + 1 


*0/2  + 


(n  + 2).  , . .(n/2  + 1) 


V 7-  1 


•^0/1- 


/n/2  + 1 


a 


x [(i-n)w"I)-Ay,A,2"ll-A1(i-n) 

V 7 = 1 


•^/i-«^i(i-n)^/i+^/1  (C11> 


n + 1 = odd  — + 


«i(»)  = **/i 

("-f"2)  (n  + 2) 

02(n)  = (AxA2)  (1-n)  -(Xj-aX2)  + 


n + 2 
' 2 

X[(l-n)W"I)-A/iA,2"1l-a- 

0=> 


/■  n/2  "\ 

X t(i • (AjAj/i  - 1 
V = 0 


■V+ 


,n  + 2 


n/2 


X [(l-n)V-(AjA2/l-a 


t = 0 


X[(l-rtW_1)-^a'Il 


*=  1 


XofX  + 


The  very  same  procedure  can  be  applied  to  n even  and  the  same  conclusion  is 
reached 

The  thesis  is  then  proven  to  be  true  and  equations  (C.4)  and  (C.5)  represent  Eq. 
(C.l)  and  Eq.  (C.2)  for  all  n. 


C.2  Limit  results. 

The  summing  parcels  of  Eq.  (C.4)  and  Eq.  (C.5)  can  be  recognized  as  the  sum  of  a 
geometric  progression  terms.  Consequently  when  n -»  °°  these  equations  will  converge  if 
and  only  if  the  following  inequality  holds: 
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a,a2(i-h)2<i  (C.12) 

Under  this  condition  it  is  not  difficult  to  conclude  that  only  the  terms  in  the  sum- 
ming parcels  will  tend  to  a value  different  from  zero.  All  other  isolated  terms  will  go  to 
zero.  Then  the  limit  is  found  to  be: 


(n  = odd)  — > • 


Ox{n)  = 


1 — cx(  1 -h)A2 
T -(i-h)2a,V 


xofi  + 


l-a(l-n)A, 


1-(1  -\ifAxAj 
02(n)zXofl 


ofl 


(n  = even) ■ 


OM)sXofl 

( 1 - a(  1 - |x)A2 


02(n)  = 


Kl-(l-v)  A ,A 


(i  -m2 


l-a(l-n)A, 


Xofl  + 


ofl 


(C.13) 


APPENDIX  D 

PROOF  BY  INDUCTION  OF  F&H  x(t)  EQUATION 


Equation  (D.l)  is  the  general  form  representation  of  a system  with  a given  sate- 
space  representation.  Equation  (D.2)  is  to  be  proven  true  for  Vn  e R u {0} . 


x(t)  = eA  (t  ,o)-x(t0)+  a)  • B ■ us(a))da 

*o  (D.l) 

y(t)  = C ■ x(t)  + D ■ us(t) 


n — \ 


x((n-l)T+x)  = ^M,-(eAV 


f=0 


( t 
^0 


A • (x  — P) 


)4* 


B 


Vne  R 


*(0  )=  0 

y((n  - 1)T  + t)  = C-x((n-l)T+%)  + D-utt 

Dn  = {te  - l)T  + T<t<nT,  Vn  G R } 

(x(0  = Jc((n-l)r  + t)),(y(0  = y((n-l)r+T))  VreDn.Vne  R 


n = 0 (D-2) 
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D.l  Hypothesis 

If  Eq.  (D.2)  is  valid  for  all  n,  (in  particular  for  x(t ) \f  _ nT),  then  for  n + 1 Eq.  (D.3)  is 

true. 


x(nT  + t)  = 


X ui  ■ (' 
/ = 0 


A • Tv 


( X 


A(t-P) 


)dp 


B 


Vne  It 


Vo 


x(0+)=  0 n-  0 

y(nT  + x)  = C • x(nT  + x)  + D • 

Dn  = (re  91:«r+T< r< (n  + l)r,  V«g  K} 

(x(t)  =x(nT+x)),(y(t)  = y(nT+x))  VteDn,  Vn  e X 


(D.3) 


D.2  Proof  of  the  hypothesis  veracity 

• The  first  element  of  the  series  is  when  n = 1 . Then  directly  from  Eq.  (D.2): 


x(t)  = w0 


( x A 

A-(x-P) 


J<‘ 


VP 


VO 


y 


x(0+)=  0 

y(x)  = C • x(x)  + D un 


n - 0 


D1  = (re  9i\x<t<T} 

(x(t)  = x(x)),(y(t)  = y(x))  VreDl 


(D.4) 


Using  Eq.  (D.l),  and  assuming  initial  state  x(t) I _ . = 0 , results  in: 

l/0  — o 


x 


X(T)  = Uq 


J< 


5 


(D.5) 


vo 

Since  the  integration  is  halted  for  the  rest  of  the  period  T-x  (s),  then  x(t)  is  con- 
stant during  the  interval  of  time  t e [x,  T]  (s).  This  result  can  be  represented  as  Eq.  (D.4). 
Equation  (D.2)  gives  a correct  result  for  the  first  element  of  the  series. 
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To  prove  for  n + 1 equation  (D.l)  needs  to  be  calculated  for  t = nT+x.  Using 

the  initial  condition  .x(r)|  = x{nT)  given  by  Eq.  (D.2).  results  in  the  fol- 

lr0  = nT 

lowing  equation: 

n — i i 

A ■ (t-P)> 

q-  -ye  ) ■ 

i = 0 


. N A ■ {nT  + x-nT)  , At."  1 ' 

x(nT+  t)  = e •)]«,••(«  ) 


VO 


B + 


(D.6) 


nT  + T 


| (eA  ('nT+x  a)  • B ■ us(a))da 


Making  the  change  of  variable  (3  = a - T on  the  second  integral  and  knowing  that 
us(a)  = un,  a e [nT,nT  + t]  then  results  into  Eq.  (D.7) 


x(nT  + x)  = 


(n-  1 

V| 

( T 

\ 

/ A t »-«■ 

■(e  ) +un 

• 

j</  (,-|Vp 

v;  = o 

> 

vo 

7 

B 


<=>x(nT+x)=  '^ui-(eA  T) 
/ = 0 


(x  ^ 

A(t-P) 


1« 


VP 


VO 


■B 


y 


(D.7) 


Having  in  mind  that  the  integration  is  halted  for  t e [nT  + x,  nT],  Vn  e X then  Eq. 


(D.7)  can  be  represented  by  Eq.  (D.3). 

y.  The  thesis  is  then  proven  to  be  true  and  Eq.  (D.2)  represent  Eq.  (D.l)  for  all  n. 


APPENDIX  E 

DISCRETE-TIME  F&H  GENERIC  DIFFERENCE  EQUATION  AND  Z TRANSFORM 


( T 

\ 

x{nT)  = eM  ■ x[(n- l)T]  + un_l  ■ 

r/(,-a)da 

vo 

y 

**x(nT)  = eM-x[(n-l)T]  + un_l-(-A-leA{'-a)Q-B 
<^>x(nT)  = eAx -x[(n-  1)7]  + un_l  • [-A  l-I  + A 1 • eAx]  • B 

<*x(nT)  = eM  ■x[(n-l)T]  + un_l-[eAx-I]-A~l -B  (E.2) 

Z{  x(nT)  = eM  • x[(n - 1 )T]  + un_l  ■ [eM -I]  • A 1 • B}  — > 

X(z)  - z’1  ■ eAx  ■ X(z)  = z'1  U(z)  • [eM  - 1]  • A~l  • B 
« X(z)  = [/  - z'1  • eAx]1  • z_1  U(z)  ■ [eAx  -I]  A~l-B 

T(z)  = C ■ X(z)  + D ■ U(z) 

1 — 1 ”1  A t —1 

e*Y(z)/U(z)  = C[I-z  -e *T]  -z  • [eAX  -I]-  A 1 B + D 
<=>  T(z)/Z/(z)  = (C-tZ-z'1*/^]"1  -z'1  -[eAkT-I]  A'l  B + Dy,k  = x/T  (E.3) 
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